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SYSTEM AND METHOD FOR DETERMINING 
A SEED VIGOR INDEX FROM GERMINATED SEEDLINGS 
BY AUTOMATIC SEPARATION OF OVERLAPPED SEEDLINGS 

5 Copyright Notice 

A portion of the disclosure of this patent document contains material to which a 
claim for copyright is made. The copyright owner has no objection to the facsimile 

reproduction by anyone of the patent document or the patent disclosure, as it appears in the 
Patent and Trademark Office patent file or records, but reserves all other copyright rights 
10 whatsoever. 

Field of the Invention 

The present invention relates generally to the field of seeds and systems and 
methods for determining seed vigor, and more specifically to a system and method for 
15 automatically determining a seed vigor index by analysis of a scanned image of a plurality 
of seedlings grovm from a lot of seeds, including the ability to automatically separate and 
analyze overlapped seedlings. 
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Background of the Invention 

Seed vigor testing is a procedure for evaluating the quality of a seed lot based on 
visually quantifiable cues, such as speed and uniformity of seedling growth. 
Various specifications for seed vigor testing exist, including the Association of Official 
5 Seed Analysts Vigor Testing Handbook (1983) and International Seed Testing Association 
Seed Vigour Testing Handbook (1987). 

Although such tests provide meaningful results to the seed community, they are not 
routinely performed because of labor intensiveness and subjectivity, which typically 
varies from seed analyst to seed analyst, even among Registered Seed Technologists 
10 (RSTs). Such subjectivity also has hindered the performance of meaningfiil research into 
seed vigor, preventing widespread use of seed vigor testing beyond a few key crops. 

Additionally, the known existing systems for automatically determining seed vigor are 
overly simple and/or prohibitively expensive, requiring costly cameras and/or special 
hardware such as special germination chambers. 

15 

Summary of the Invention 

The present invention provides a system and method for automatically 

determining seed vigor index by analysis of a scanned image of a plurality of seedlings 
grown from a lot of seeds. 

20 According to one aspect of the current invention, seedling analysis software is 

used to analyze an image of seedlings. The seedling analysis software preferably analyzes 
both hypocotyl and radicle lengths and thus determines the separation point between the 
two for each seedhng. The seedling analysis software also preferably separates overlapped 
seedlings, preferably using a simulated annealing technique. 

25 According to another aspect of the present inYention^ a low-cost scanner placed in 

an inverted configuration in a scanner enclosure is used to generate high-quality, 
reproducible images of seedlings. 

According to yet another aspect of the present invention, a method of using 
ordinary germination boxes, i.e., "sandwich boxes" is used to germinate seedlings that 
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greatly facilitate computer-based analysis. In general, this method comprises placing 
germination blotter paper in the lid of a sandwich box and growing seedlings within the 
sandwich box in a nearly vertical (upright) position in a darkened germination chamber. 

The resulting seedlings produce hypocotyls that grow essentially upward and radicles that 
5 grow essentially downward, which greatly facilitates image acquisition of the entire 
seedling, e.g., with an inverted scanner. Additionally, according to this aspect of the 
present invention, seeds are gently pressed into the moistened blotter paper(s) to help them 
remain in place when the sandwich box is placed in the nearly vertical position. 
Additionally, because the seedlings are grown in the Ud of the sandwich box^ the Ud can be 
10 separated from the rest of the sandwich box to facilitate image acquisition. In the case of 
an inverted scanner, the hd and seedhngs are placed in a Hd-holder, which slides the lid 

and seedhngs under the inverted scanner to facilitate scanning. 

It is therefore an advantage of the present invention to provide a system and 
method for determining a seed vigor index using seedhngs grown in the Ud of a sandwich 
15 box to facilitate image acquisition. 

It is also an advantage of the present invention to provide a system and method for 
determining a seed vigor index using seedling analysis software that analyzes both 
hypocotyl and radicle lengths as determinants of seed vigor. 

It is therefore another advantage of the present invention to provide a system and 

20 method for determining a seed vigor index using seedling analysis software that separates 

overlapped seedlings, preferably with simulated annealing. 

It is a further advantage of this invention to provide a system and method for 
determining a seed vigor index using seedlings grown such that their hypocotyls and 
radicles are substantially paraUel to each other to facilitate image acquisition and analysis. 
25 It is yet another advantage of the present invention to provide a system and 

method for automatically determining a seed vigor index. 

It is yet another advantage of the present invention to provide a system and 
method for automatically determining a seed vigor index using seedling analysis software 
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that determines a separation point for hypocotyl and radicle for a given seedling, e.g., by 
analyzing root hairs and secondary roots. 

It is still another advantage of the present invention to provide a system and 
method for automatically determining a seed vigor index using seedling analysis software 
5 that analyzes the ratio of the radicle length to the hypocotyl length. 

It is yet another advantage of the present invention to provide a system and 
method for automatically determining a seed vigor index using seedling analysis software 

that analyzes uniformity of seedlings, e.g., uniformity of hypocotyl length, uniformity of 

radicle length, uniformity of total length, uniformity of the ratio of the radicle length to the 
10 hypocotyl length, and/or the number of dead seeds, and preferably that analyzes standard 
deviation of hypocotyl length, standard deviation of radicle length, standard deviation of 
total length, standard deviation of the ratio of the radicle length to the hypocotyl length, 

and/or the number of dead seeds. 

These and other advantages of the present invention will become more apparent 
15 from a detailed description of the invention. 

Brief Description of the Drawings 

hi the accompanying drawings, which are incorporated in and constitute a part of 

this specification, embodiments of the invention are illustrated, which, together with a 
20 general description of the invention given above, and the detailed description given below 
serve to example the principles of this invention. 

Figure 1 is a schematic block diagram showing various components of the present 
system and method; 

Figure 2 is a perspective view of a lid of a germination box, i.e., a sandwich box, 
25 having several soaked pieces of blotter paper placed therein with a pluraHty of seeds 
pressed thereon; 

Figure 3 is a side view of a sandwich box with the base secured to the lid of 

Figure 2 and placed in a nearly upright position; 


23727-04060 


4 


Figure 4 is a perspective view of an inverted scanner enclosure of the present 
invention with the scan drawer in the closed/scan position; 

Figure 5 is a perspective view of the inverted scanner enclosure of Figure 4 with 
the scan drawer in the open position, with a sandwich box lid with blotter paper and 
5 seedlings held in place by the lid retainer; 

Figure 6 is a cutaway front view of the inverted scanner enclosure of Figure 4 
with the drawer face, front enclosure face, and front lid face removed to show the position 
of the scanner relative to the enclosure and hd tray; 

Figure 7a is a sectional view of the of the inverted scanner enclosure of Figure 4 
10 taken along the line 7 — 7 in Figure 6, with the drawer face, front enclosure face, and front 
lid face in place and in the scan drawer in the closed position; 

Figure 7b is a sectional view of the of the inverted scanner enclosure of Figure 4 
taken along the line 7 — 7 in Figure 6, with the drawer face, front enclosure face, and front 

lid face in place and in the scan drawer in the open position; 
15 Figure 8 is an exploded view of the of the inverted scanner enclosure of Figure 4; 

Figure 9 is a color screenshot of the seedling analysis software of the present 
invention; 

Figure 10 is a flowchart showing a general overview of the seedling analysis 
software of the present invention; 
20 Figure 1 1 is a flowchart showing generally how the seedling analysis software of 

the present invention determines seedling skeletons from a digital seedling image; and 

Figure 12 is a flowchart showing generally how the seedling analysis software of 
the present invention determines the primary axis for each seedling. 

25 Detailed Description of the Preferred Embodiment 

Tircuit communication" as used herein indicates a communicative relationship 

between devices. Direct electrical and optical connections and indirect electrical and 
optical connections are examples of circuit communication. Two devices are in circuit 

communication if a signal from one is received by the other, regardless of whether the 
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signal is modified by some other device. For example^ two devices separated by one or 
more of the following — transformers, optoisolators, digital or analog buffers, analog 
integrators, other electronic circuitry, fiber optic transceivers, or even satellites — are in 
circuit communication if a signal from one reaches the other, even though the signal is 
5 modified by the intermediate device(s). As a final example, two devices not directly 
connected to each other, but both capable of interfacing with a third device, e.g., a CPU, 
are in circuit communication. As used herein, "input" refers to either a signal or a value 
and "output" refers to either a signal or a value. As used herein, the term "hypocotyl" 
refers to the portion of a seedling between the cotyledon and the radicle (root or roots) or 
10 between the seed coat and the radicle, if a cotyledon is not apparent. As used herein, the 

hypocotyl starts at the seed coat or cotyledon and ends at the first root hair, which is 

considered to be the beginning of the seedling radicle. As used herein, the term 
"overlapped" in the context of overlapped seedlings means seedlings that cross, seedhngs 
that share an edge, and/or seedlings that otherwise form part of a single object in a seedling 

15 image (e.g., seedhngs that form part of the same object in a binary image determined fi*om 
an image of seedlings) after the seedling image is processed. 

Referring now to Figure 1, an overview of certain elements of a system 10 
according to the present invention are shown. In the broadest sense, the system 10 of the 
present invention comprises a system and method for automatically determining a seed 

20 vigor index for a batch of seeds. A particular embodiment of that system is shown in 
Figure 1. With reference to that figure, the system 10 of the present invention comprises a 

computer system 12 having a processor unit 14 in circuit communication with one or more 

display devices, e.g., monitor 16 and/or printer 18, in circuit communication with one or 
more input devices, e.g., mouse 20 and/or keyboard 22, and in circuit communication with 
25 an image capture device to capture an image of one or more seedlings germinated from a 
representative sample of seeds from the batch of seeds being analyzed. Preferably the 
image capture device is an inverted scanner 24, i.e., an upside-down scanner, which 
preferably comprises an ordinary scanner inverted in a special enclosure that holds the 
scanner in an inverted configuration and holds one or more seedlings proximate to the 
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glass scanning surface of the scanner for scanning. The seedlings to be analyzed are 

preferably grown using a novel method of using a germination box 26, i.e., a sandwich box 
26, to grow seedlings having a specific orientation of hypocotyl and radicle, as will be 

explained herein. 

5 According to the present invention, the seedlings under analysis are preferably 

grown in a sandwich box that is vertical or nearly vertical. In the prior artj seedlings are 
typically grown in sandwich boxes with the longitudinal axis of the sandwich box 
positioned horizontally. Seedlings grown in such a manner typically have hypocotyls that 

grow vertically and radicles that grow horizontally, which is not conducive to automatic 

10 analysis of a single scan. According to the present invention, seedlings are grown with 
their hypocotyls generally parallel to their radicles, or at least grown with their hypocotyls 
essentially in the same plane as their radicles. This is accomplished by allowing the 
subject seeds to germinate in the dark in a sandwich box that is vertical or nearly vertical. 
Under such conditions, the seedlings tend to grow with their hypocotyls generally parallel 

15 to their radicles, or at least with their hypocotyls in generally the same plane as their 
radicles, either of which facilitates analysis using a single scan because the scan can 
include both seedling radicles and seedling hypocotyls. In the dark, seedhng hypocotyls 
tend to grow upward and seedling radicles tend to grow downward. Placing the sandwich 
box vertical or nearly vertical allows the dark-germinated seedlings to grow so that they 

20 essentially lie flat on the blotter paper. 

To further facilitate scanning of seedlings, the seedlings are preferably grown on a 
suitable medium, e.g., blotter paper, in a very shallow container, e.g., a lid of a sandwich 
box. This facihtates scanning by permitting the shallow container, e.g., the hd of the 
sandwich box, to be placed proximate to the scaiming surface without handling the 

25 medium on which the seedlings were grown. Referring now to Figure 2, a shallow 
container, i.e., a lid 50 of a sandwich box 26 is shown. The hd 50 preferably has a shallow 
lip 52. The particular sandwich boxes 26 used in the implementation of this embodiment 
of the present invention are about 6 3/8" by about 9 5/8" and use blotter papers that are cut 
to about 51^" by about 9". These boxes are available from numerous sources known to 
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those in the art, e.g., Model 600C available from Pioneer Packaging, Dixon, KY. These 

boxes typically have a hinge and a closing clasp, neither of which are shown in Figure 2. 
Although these boxes are preferred because of their size, virtually any sized germination 
sandwich box could be used, subject to availabihty. The blotter paper is preferably blue 
5 germination blotter paper available from numerous sources known to those in the art, e.g., 
Anchor Steel Blue Seed Germination Blotter paper available from Anchor Paper 
Company, St. Paul, MN. The blue color of this germination paper provides a relatively 

high contrast with the seedlings and facilitates separating seedlings from the blotter 
background in the seedling images. 

10 Preferably, two sheets 54, 55 of blotter paper are used to germinate lettuce 

(Lactuca sativa L.) seeds by providing adequate moisture to allow the lettuce seeds to 
germinate in the germinator. More sheets might be needed to provide adequate moisture 
for other seeds, e.g., soybeans {Glycine max (L.) Merr.). These two sheets 54, 55 are 
preferably thoroughly wetted with a suitable germination solution, e.g., distilled water. 

15 Also shown in Figure 2 are fifty (50) lettuce seeds 58 arranged ui two rows of twenty-five 
(25) seeds, with the centers of the seeds nominally spaced at about 8.8 mm apart, with the 
two rows nominally spaced 5.0 cm apart. This arrangement of lettuce seeds tends to 
minimize overlap between seedlings germinated at 3 days. Seeds can be placed in a proper 
configuration using any suitable method, including using a vacuum plate known to those in 

20 the art, with the vacuum plate having two rows of twenty-five holes each spaced as 
discussed above. The foregoing spacings are preferred for lettuce seeds. Seeds of different 
species which are to be germinated into seedlings for analysis may require different 
spacings. An important criterion is that the seeds be spaced so as to tend to minimize 
overlap between seedlings. For example, on the one hand, one species of impatiens, 

25 Impatiens walleriana, tends to have a single primary root and several shorter secondary 
roots, and can be germuiated using the 2x25 configuration discussed above for lettuce. On 
the other hand, seedlings of a different species of impatiens, Impatiens balsamina, are 
bigger than the other species and typically have four to six roots of about the same size that 
fan out, and consequently, their seeds need to be spaced further apart, e.g., 15 mm apart in 
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2 rows of 15 seeds each, with the rows being 5.0 cm apart. Some species, because of the 
relatively large size of their seedlings, would not be germinated on blotters but on a 

different medium more suitable for larger seedlings, e.g., on 10 x 20 inch paper 
germination towels. In this situation, the inverted scanner of the present invention might 
5 not produce acceptable results and another digital imaging device would be used to capture 
the appropriate seedhng image, such as a digital camera positioned essentially 
perpendicular to the seedlings, e.g., above the seedlings when positioned horizontally. The 
seedling analysis software of the present invention would function acceptably well on a 
seedling image of suitable resolution and quality acquired by virtually any digital imaging 

10 device, although some of the software parameters of the present invention might need to be 
altered to take into account different characteristics of seedling images acquired by 
different digital imaging devices, e.g., different effective dpi levels. 

After the seeds are placed on the two sheets 54, 55 of wet blotter paper, the seeds 
are preferably gently pressed onto the blotter paper. This pressing depresses the seeds into 
15 the surface of the upper piece 55 of blotter paper, which helps prevent the seeds 58 from 
falling off of the blotter paper when the sandwich box 26 is placed in a vertical or near 

vertical position in the gemiinator. A hard plastic plate, e.g., a smaller sandwich box, can 
be used to gently press the seeds 58 onto the upper sheet 55. Larger seeds can be held in 
place using the same method, or by sandwiching the seeds between two pieces of 

20 moistened germination blotters. 

Referring now to Figure 3, after the seeds are pressed onto the upper sheet 55 of 
blotter paper, the base 60 of the sandwich box 26 is connected to the hd 50 and placed in a 

germinator (not shown) in a vertical or nearly vertical position. The angle a between the 
lid 50 and an imaginary vertical surface 62 is preferably as low as practical (a=0** indicates 

25 a vertical orientation) for the specific type of seed being germinated and analyzed. For 

example, for lettuce, the angle a is preferably between 0** (vertical) and 15°, more 
preferably between 0** (vertical) and 10** and most preferably 0° (vertical). As another 
example, for soybeans, the aagle a is preferably between 0"* (vertical) and 45"*, more 
preferably between 0*" (vertical) and 10° and most preferably 0*" (vertical). No matter 
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which crop being analyzed, it is desirable and preferable to have the angle a be as close to 
0 degrees (vertical) as possible to ensure that the seedling roots (radicles) grow down and 
the seedling shoots (hypocotyls) grow up, so that they are preferably essentially in the 

same plane^ which facilitates the seedling analysis. 
5 After the seedlings have germinated for a number of days, preferably 3-5 days for 

certain species, more preferably 3 days for certain species, an image of the seedlings must 
be taken. Although numerous devices can be used to create an image of the seedlings, e.g,^ 
a scanner or a digital camera, it is most preferred to use an inverted scanner, i.e., an upside- 
down scanner, to generate a digital image of the seedlings. Li the altemative, a scanner in 
10 the vertical position, nearly vertical position, or some other rotated position (preferably 
rotated at least 90** from the horizontal) can be used to generate a digital image of the 
seedhngs (under the rationale that if the seedlings can be germinated at a vertical or nearly 
vertical angle, then they can be scanned at a vertical, nearly vertical angle, or some other 
angle as well). In either case, the specially enclosed scanner of the present invention has 

15 been shown to provide uniform lighting across seedling blotters, which leads to relatively 

uniform intensity within images and relative uniformity of lighting between scans. Digital 
cameras, in contrast, can have relatively non-uniform lighting within an image (e.g., "hot 
spots") and can vary significantly in intensity fi*om image to image. Figures 4-8 show an 
inverted scanner 24 according to the present invention. The inverted scanner 24 comprises 

20 a scanner 70 held upside-down in a scanner enclosure 72. A very important criterion for 
the scanner 70 is that it fimction inverted, i.e., upside-down. One suitable scanner 70 is a 
UMAX Astra 2000U scanner, which is commonly available from numerous sources. This 
scanner and other scanners are typically shipped with a scanner lid (not shown) that would 
be used to cover the material being scanned during scanning. This lid is removed from the 

25 scanner 70 before it is placed in the inverted scanner enclosure 72. The scanner enclosure 
72 comprises a scanner lid 74 and a base 76. The scanner hd 74 comprises a hd top 78, 
front lid face 80, two side lid faces 82, 84, and a rear hd face 86. The four pieces 80, 82, 
84, and 86 may be made from sheet metal, bent from extensions of lid top 78, and welded 
or brazed together at 90° angles to form the lid 74. The scanner 70 is held to the assembled 
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scanner lid 74 with four sheet metal screws 90a-90(i extending through holes in pieces 80 

and 86 and into the plastic feet or legs of the scanner 70. The scanner base 76 comprises a 
base bottom 92, front base face 94, two side base faces 96, 98, and a rear base face 100. 

The four pieces 94, 96, 98, 100 may be made from sheet metal, bent from extensions of 
5 base bottom 92, and welded or brazed together at 90** angles to fomi the base 76. 

The inverted scanner 24 has a scanner drawer 110 comprising a drawer base 112 
and a drawer face 114 integrally formed with or physically annexed to (e.g., riveted to, 
bolted to, welded to, brazed to, adhered to, etc.) drawer base 112. The drawer base 
preferably has a scanning tray 115, which accepts and generally retains in place the 
10 shallow dishes containing the germinated seedlings, e.g., sandwich box lid 50. The tray 
115 may be formed from four metal L-brackets 116a-116d which are integrally formed 

with or physically annexed to (e.g., riveted to, bolted to, welded to, brazed to, adhered to, 
etc.) drawer base 112. Scanning tray 1 15 is preferably positioned so that the entire shallow 
dish (e.g., sandwich box Ud 50) is positioned directly below an active scanning area of the 
15 scanner 70. The four metal L-brackets 116a-116d are preferably sized so that the shallow 
dish (e.g., sandwich box lid 50) may be easily placed into the tray 115 for scanning and 
easily removed therefrom. The front base face 94 of scanner enclosure has an opening 120 
therein, through which the drawer base 112 extends. Drawer face 114 has four strips 1 18a- 

118d of 1/8" thick rubber about 1/2" wide secured thereto with suitable adhesive, which 
20 form a rectangular light seal, which helps prevent extraneous light from entering the 
enclosure 72 through opening 120. Drawer face 114 also has a knob or pull 122 used to 
open and close drawer 110. 

Inside enclosure 72 are two shelves, a wider shelf 130 and a narrower shelf 132, 

that support scanner 70. The shelves 130, 132 are preferably formed from pieces of bent 

25 sheet metal and are integrally formed with or physically annexed to (e.g., riveted to, bolted 
to, welded to, brazed to, adhered to, etc.) the base bottom 92, front base face 94, two side 

base faces 96, 98, and rear base face 100 in the positions shown in the figures. Anterior 

surfaces 134, 136 of the shelves 130, 132 have physically annexed thereto (e.g., riveted to, 
bolted to, welded to, brazed to, adhered to, etc.) and support at least one pair of shde 
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brackets 140, 142. Slide brackets 140, 142 accept slides 144, 146 physically annexed to 
(e.g., riveted to, bolted to, welded to, brazed to, adhered to, etc.) scanner drawer 110 in 
such a manner that scanner drawer 110 can be moved from the open position to place 

seedlings on the scanner tray 115 (Figures 5a and 5b) and the closed position for scanning 
5 (Figure 4). Roller brackets 140, 142 and rollers 144, 146 of scanner drawer 110 are 
positioned with respect to anterior surfaces 134, 136 and slide base 112 such that the 
bottom of scanning tray 115 is positioned about 7/16" below the bottom enclosure plane 
150 of inverted scanner 70. Since scanner glass 152 of this particul^ inverted scanner 70 

is located about 1/8" into the bottom enclosure plane 150, the scanning tray 115 is 

10 positioned about 9/16" below the bottom of scanner glass 152 of this particular inverted 
scanner 70. Scanner 70 rests upon two 1" strips of thick rubber, supported by shelves 
130, 132, with the bottom edge 164 of scanner enclosure lid 74 resting upon the upper 
edge 166 (all the way around) of seamier enclosure base 76. Enclosure base 76 also has 

openings 170a, 170b through which power and data cables of scanner 70 extend to be 
15 placed in circuit communication with a power source and a data acquisition system, e.g., 

computer system 12. 

The inside of enclosure 72 is preferably painted, or otherwise coated or anodized, 
a black color, preferably matte or flat black, to help prevent stray light inside the enclosure 
72 from affecting the scanning procedure. 

20 Although the individual parts of scanner enclosure 72 have been described as 

being made of metal or sheet metal and physically annexed (e.g., riveted, bolted, welded, 
brazed, adhered, etc.) together, this description was merely illustrative of one suitable 
construction method for the inverted scanner 24. In the alternative, most or all of the 
component parts of scanner enclosure 72 may be formed from any suitable plastic or 

25 polymer material and secured using any suitable combination of fasteners, adhesives, 
and/or welding or brazing. Additionally, in the altemative, rather than placing an off-the- 
shelf enclosed scanner in a special second, inverted enclosure, the internal parts of a 
scaxmer can be placed in a single dedicated inverted scanner enclosure (not shown) having 
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a drawer with a scanning tray that accepts the small containers in which the seedlings are 
grown (all not shown). 

In use, a plurality of seedlings are germinated in accordance with the text 
accompanying Figures 2 and 3 on wet blotter paper in the lid 50 of a sandwich box placed 

5 in a vertical or nearly vertical position. After a desired amount of seedling growth, e.g., 
after a predetermined number of days of growth, e.g., 3 days, the lid 50 is removed from 
the base 60 of the sandwich box 26 for scanning. With the scanner in an idle mode, the 
user pulls drawer pull 122 to withdraw drawer 110 far enough out of enclosure base 76 that 
the lid 50 may be laid into scanning tray 115. Next, the drawer 110 is pushed back into 
10 enclosure base 76 so that the rubber lightly 1 18a-l 18d engages front face 94. Next, a scaa 

of the seedlings is taken with inverted scanner 70, preferably using the separate scanner 

interface/scanning program (not shown) that accompanied the scanner 70. The file 
representing the scan is then saved to a suitable medium, e.g., a fixed disk of a hard disk 
drive in computer unit 14, preferably with the interface/scanning program that 

15 accompanied the scanner 70. A 24-bit scan at 200 dots per inch (dpi) is sufficient to 
achieve usable results with lettuce seedlings. For other crops, a higher resolution might be 
needed or a lower resolution might produce adequate results. The area of the scan is set to 
match the size of the rectangular blotters 54, 55 on which the seedlings were grown. The 
scan may/may not include regions outside the area of blotters 54, 55. 

20 The software of the present invention contains seedling analysis software and 

other fixnctions associated therewith. The software is preferably a stand-alone executable 
program that executes on systems operating typical operating systems, e.g., Windows 95 
and Windows 98. Figure 9 is a screenshot 200 captured fi*om the software of the present 

invention executed on computer system 12 executing Windows 98 as its operating system. 
25 Computer system 12 can be a DELL Dimension XPS T600 computer system having a 600 
MHz Pentium III processor with 256 MB of memory, placed in circuit communication 

with inverted scanner 24 via an appropriate communications protocol, e.g., a Universal 

Serial Bus (USB) communications protocol in the case of the UMAX Astra 2000U 
scanner. 


22727-04060 


13 


The screenshot 200 shows icons implementing some of the functions of the 
software, such as creating a new seed vigor database, opening a seed vigor database, 
saving a seed vigor database, showing a seed vigor database, opening a seedling image, 
saving a seedling image, analyzing a blotter of seedlings, analyzing a lot of seeds, 
5 generating a histogram of seedling information, and printing. Actuating the ^Tsfew 
Database" icon clears the current database stored in system RAM. A database in the 
seedling analysis software of the present invention comprises the following elements; seed 
lot ID, date of testing, date of seed acquisition, vigor index, growth value, xmiformity 
value, individual measurements for each seedling (e.g., hypocotyl length, radicle length, 
10 total length, and ratio of hypocotyl length to radicle length), statistical calculations for the 
particular seedling image (mean hypocotyl length, mean radicle length, and standard 

deviation of hypocotyl length, radicle length, total length, and ratio of hypocotyl length to 
radicle length), weights for the seed vigor index calculation, and comments. Actuating the 
"Open Database" icon opens a dialog box that prompts the user to enter or select the name 
15 of an existing database file. When the dialog box is actuated, the contents of the selected 

file are loaded into memory as the database. When the "Save Database" icon is pressed, 

the database contents are written to the opened file or to a new file selected by the user. 
Actuating the "Show Database" icon opens up a window that displays the contents of the 
database (e.g., seed lot ID, date of testing, date of seed acquisition, vigor index, growth, 
20 uniformity, and comments). Actuating the "Open Image" icon opens a dialog box that 
prompts the user to enter or select the name of a file corresponding to a scaimed image of a 
blotter and seedlings. When that dialog box is actuated, the file corresponding to the 
scanned image of a blotter and seedlings is loaded into memory and available for analysis. 
Actuating the "Save Image" icon saves the image being displayed on the screen to a file in 

25 a standard graphic file format, such as either the JPEG or the TIFF file format. Actuating 
the "Analyze Blot" button initiates software analysis, i.e., the routines of Figures 10-12, of 
the blotter and seedling image currently loaded in memory preferably by actuating the 
"Open Image" icon. When the software processing is complete for that one image, a seed 
vigor index and other values are determined from the information determined from that 
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one image, and the test results are output to the screen (see Fig. 9). Actuating the "Analyze 
Lot" icon opens a dialog box to have the user select a plurality of seedling image(s) of the 
particular lot being tested for a combined analysis. When the dialog box is actuated, the 
software analyzes each image individually, in turn, determines the hypocotyl lengths, 
5 radicle lengths, etc. of all the seedlings in each image, determines a seed vigor index and 
other values using the information about all of the seedlings determined from the multiple 
images, and the combined test results are output to the screen. The "Analyze Lot" function 
allows a user to combine analyses of more than one image into a single set of seed vigor 

values for a specific lot of seeds. For example, the standard number of seeds analyzed in 
10 seed vigor testing is 200 seeds; with the 50-seeds-per-blotter configuration described 
herein for certain species, the user would select four images of four different seedlings and 
blotters for a total of 200 seeds, and the software of the present invention presents a seed 
vigor index and other values for all 200 seedlings. The user can select virtually any 
number of blotters for combined analysis via the "Analyze Lot" function. Actuating the 
15 "Histogram" icon opens a window that displays the histogram of a user selected parameter 
such as hypocotyl length, radicle length, and total length. The "Print" icon prints out the 
image being displayed on the screen to the printer 18. These and other functions can also 

be executed via menu commands, as known to those skilled in the art. 

Referring now to Figures 10-12, an overview of the seedling analysis software of 
20 the present invention is shown. The source code for a majority of the seedling analysis 
software is appended hereto as Listing 1, Listing 2, and Listing 3, and incorporated herein 
by reference. A general overview 210 of the seedling analysis software is foimd in Figure 
10, which begins at 212, As indicated at 214, the seedling analysis software requires an 
image of a blotter and seedlings. This preferably takes the form of a data structure 
25 corresponding to the scanned image of a blotter and seedlings that was loaded into memory 
with the "Open hnage" icon/fiuiction. 

The data structure corresponding to the scanned image of a blotter and seedlings is 
processed by routine 216 to determine seedling skeletons. The seedling skeletons are 
preferably a locus of adjacent pixels, one pixel wide, that extends from the top of the 
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hypocotyl to the bottom of the primary root of the radicle, roughly through the center of 

the seedling and includes portions for each structure of the seedling, including all root 
hairs, etc. Figure 11 shows additional details about the skeleton determining routine 216, 
which starts at 218. At task 220, a seedling image is generated by removing the 

5 backgroxmd, i.e., removing the blotter jfrom the image leaving an image of the seedlings. 
The seedling image generated by step 220 is preferably a binary image of the seedlings 

(cotyledonsj hypocotyls, radicles, root hairs, etc) of the same size as the original image 

with the seedlings (cotyledons, hypocotyls, radicles, root hairs, etc.) in the foreground. 
This binary image is preferably generated using thresholding based on the intensity of red 

10 pixels that occur most frequently in the original image. More specifically, the software at 
task 220 determines the intensity of red Vmax (on a scale of 0 to 255 for 24-bit color) that 
occurs most frequently in the original image. The threshold for the thresholding step is 
then set to Xmax plus a certain value, preferably 40 for certain plants (such as lettuce). Next, 
the software at task 220 generates the binary image with pixels meeting the following 

15 criterion being in the foreground: a red intensity of between (Tmax + 40) and 255, a green 
intensity of between 0 and 255 (any green intensity), and a blue intensity of between 0 and 
255 (any blue intensity). The resulting image is a binary image with the seedlings 
(cotyledons, hypocotyls, radicles, root hairs, etc.) in the foreground. 

Next, at step 222, the binary seedling image generated at step 220 is filtered to 

20 remove noise. Under the assumption that noise will take the form of small groups of 
pixels, this filtering step preferably comprises removing all objects (an object is a 
contiguous group of pixels) from the image having less than a certain number of pixels. 

To facilitate the filtering, all the objects in the binary seedling image are preferably labeled 
and listed in a List of Objects data structure, which includes for each object in the binary 
25 seedling image: a unique object label, the bounds of that object (x^nm, x^ax, Ymim Jma^d^ 
and the number of pixels in that object. 

To create the List of Objects, object labeling (also known as connected-component 
labeling) is used. This is a technique used for extracting connected components (i.e., 
objects) from a binary image based on a pixel neighborhood system. Typically, a pixel 
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neighborhood system is either 4-connected or 8-connected. In the 4-connected system, a 
pixel's neighbors (i.e.^ pixels that are "connected" to the pixel) are the pixels adjacent at 
north, south, east, and west of the pixel. In the 8-connected system, a pixel's neighbors 
include the four pixels mentioned as well as northeast, northwest, southeast, and 

5 southwest. The object labeling of step 222 is preferably implemented using the 
8-connected system; pixels are connected diagonally as well as vertically and horizontally. 

In performing the object labeling of step 222, preferably the pixels in the binary 
image are scanned in raster-scan order. The first block of contiguous foreground pixels 

(called a "run") in the same row are marked as belonging to the first object. When another 

10 run of foreground pixels is encountered in the same row, then the run is labeled as the next 
object. The next run encountered in the row is marked as the next object, and so on, imtil 
the end of the row. When a run is encountered in the next row of pixels, it is labeled as a 

new object unless any of its pixels are connected to runs in the row above. If the run is 
connected to only one run in the upper row, then the same label is used for the run as the 

15 one for the run above. If the run is connected to two or more runs, then the label for the 
run is the first run encountered in the above row, and the labels for the other connected 
runs are relabeled as equivalent to that label These equivalent labels are rewritten to the 

representative label by performing another raster scan. At the end of the whole procedure, 
each connected component (i.e., each object) has a unique label. For each object, the 

20 bounds and size in pixels are determined. 

Having generated a List of Objects for the binary seedling image generated at step 
220, the filtering process can be done by removing all objects fi*om the hst having fewer 
than a predetermined number of pixels, preferably fewer than 100 pixels for certain plants 
(such as lettuce scanned at 200 dpi). Next, from this filtered List of Objects, a filtered 

25 binary seedling image is created by adding the objects remaining in the filtered List of 
Objects to a new binary image that represents the filtered binary seedling image. 

Then, at step 224, the filtered binary seedling image created in step 222 is 
smoothed to remove any jagged edges resulting fi-om any of the previous processing steps, 
which facilitates skeleton determination. The filtered binary seedling image created in step 
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222 is preferably smoothed using a binary image median filter. A preferred binary image 
median filter uses a kernel size of three pixels (i.e.j a three-by-three square of pixels) and 
sets a pixel to the same value as the majority value of that pixel and its eight surrounding 
neighbors. For example, a pixel that is a logical ONE and having four or more 
5 surrounding neighbors that are also a logical ONE (for a total of five or more ONEs) 

would be set to a logical ONE, and a pixel that is a logical ONE and having three or fewer 
surrounding neighbors that are also a logical ONE (for a total of four or fewer ONEs) 
would be set to a logical ZERO. The resulting image is a smoothed, filtered binary image. 
The particular median filter used was adapted from R. Gonzalez and R. Woods, Digital 
10 hnage Processing. 2""^ ed., (1992). 

Next, at step 226, the smoothed, filtered binary image generated at step 224 is 
thinned to produce the seedling skeletons. Preferably, each object in the smoothed, filtered 
binary image is iteratively made thinner and thinner until the object is reduced to a number 
of line segments that are one pixel in width. In the broader sense, this step is a form of 
15 medial axis transformation. The particular thinning algorithm used was adapted from N. 
Yagi, S. Lioue, M. Hayashi, E. Nakasu, K, Mitani, M. Okui, S. Suzuki, Y. Kanatsugu, C 

gengo de manabu jissen gazou shori [ Learn Image Processing in C ], Ohm-sha [publisher], 
pp. 53-54, 1997, and is set forth in Listing 3. The result is a thinned, smoothed, filtered 
binary seedling image that represents the skeletons for the seedlings in the original image. 

20 Nextj object labeling as discussed above is performed on the resulting thinned, smoothed^ 
filtered binary image, which results in a List of Objects data structure for the skeletons in 
the thinned, smoothed, filtered binary seedling image, i.e., a List of Seedling Skeletons, 
which mcludes for each seedling skeleton: a unique object label, the bounds of that 
skeleton (Xjnin, x^ax, Jmim and jma^d^ and the number of pixels in that skeleton. Finally, the 

25 List of Seedling Skeletons is filtered by removing all entries having fewer than a 
predetermined number of pixels, e.g., 15 pixels, again to eliminate any noise generated by 
any of the foregoing steps. This filtering action is performed in the same manner as step 
222 on the List of Seedling Skeletons. At 228, program control returns to the flowchart of 
Figure 10. 
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Referring back to Figure 10, next at routine 230 the seedling analysis software of 
the present invention determines the primary axis for each seedling. At this point in the 

analysis, a filtered List of Seedling Skeletons has been generated; however, each seedling 
skeleton does not necessarily consist of a single seedling. If any of the seedlings were 

5 overlapping or very close to each other in the original scanned image, the corresponding 
seedling skeleton will consist of those multiple seedlings. Thus, the software preferably 
comprises a routine for separating multiple seedlings and more preferably comprises a 

routine for separating multiple seedlings using simulated annealing. Next, in general, the 
software determines the hypocotyl/radicle separation point for each single or separated 

10 seedling, at 232. Then, at 234, the software determines the lengths and other statistics used 

to determine the seed vigor index and calculates the seed vigor index. Next, the software 
determines a graphical overlay to be displayed with the original scanned image to show the 
locations of the hypocotyls and radicles of the scanned seedlings, at 236. Figure 12 
provides additional information about the routines 230, 232, and 234. Finally, at task 238, 

15 the software displays the vigor index, other statistical information, and the graphical 

overlay combined with the original scanned image. 

Referring now to Figure 12, additional information about the seedling analysis is 
shown, starting at 240, The routines of Figure 12 are performed for each seedling skeleton 

listed in the filtered List of Seedling Skeletons. First, at 242, a junction graph for the 
20 skeleton is generated. In general, a junction graph is a data structure comprising a list of 
types of junctions in the skeleton, among other information. Each pixel in the skeleton is 
classified as either a terminal junction (an endpoint of the skeleton), or a connector 
junction (presimiably where root hairs or seminal roots extend fi*om the primary root, or 
where multiple seedlings overlap or meet), or not a junction. To define the junctions, a 
25 new neighborhood system was developed and used in the software of the present 

invention. The new neighborhood system uses a three-by-three neighborhood, and places 
primary emphasis on the N, S, E, and W positions and lesser emphasis on the NW, NE, 
SW, and SE positions of a standard three-by-three neighborhood map. More specifically, 
with respect to a pixel (i.e., a logical ONE) in the center of the three-by-three 
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neighborhood, if there is a pixel (i.e., a logical ONE) at any of the N, S, E, or W positions, 
then they are considered to be neighbors of the center pixel. A pixel at the NE comer is 

only considered to be a neighbor of the center pixel if there is no pixel (i.e., no logical 
ONE) at either the N or the E positions. Similarly, a pixel at the NW comer is only 
5 considered to be a neighbor of the center pixel if there is no pixel (i.e., no logical ONE) at 
either the N or the W positions. The same applies to the SW and SE positions: pixel at 
either the SE comer or the SW comer is only considered to be a neighbor of the center 
pixel if there is no pixel (i.e., no logical ONE) at either the S or the E positions^ or at either 
the S or the W positions, respectively. This new neighborhood system facilitates the 
10 generation of a junction graph used in primary axis generation and seedling separation. 

Using this new neighborhood system, a pixel is considered to be a junction if and only if 
the number of its neighbors is not two. If a pixel has only one neighbor under the new 
neighborhood system, then it is classified as a terminal junction. If a pixel has three or 
more neighbors under the new system, then it is classified as a connector junction. The 

15 remaining pixels (those with two neighbors under the new neighborhood system) form the 
"edges" of the junction graph, which are linear curve segments (portions of the skeleton) 
between junctions. An edge, i.e., a linear curve segment, cannot contain any junctions in 
this particular junction graph data stmcture. 

The junction graph is preferably determined as follows. Within the bounding box 

20 of the seedling skeleton, all pixels belonging to the skeleton are tested for the number of 
neighbors. A pixel that does not have exactly two neighbors is marked as a junction, and 
information about where its neighbors are (e.g., NW and E) is stored. When the seedling 
skeleton is completely scanned (i.e., all pixels are processed), we have all the junctions 
(nodes) of the graph for that particular skeleton. As discussed above, an edge formed by 

25 two connected junctions is made up of all pixels connecting them. Pseudocode for finding 
the edges for the junction graph is as follows: 

for each junction j 

for each neighbor n of junction j 

While current pixel is not a junction 

30 current pixel : = next pixel in the curve segment; 

end while; 

k : = junction id of the current pixel; 
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if edge (j, k) has not been inserted 
insert (j, k) into junction graph; 

else 

if length of this curve segment < edge (j,k) 

5 remove (j, k) ; 

insert ( j , k) with new curve segment distance; 

end if; 

end if; 
end for; 

10 end for; 

For each edge, the length and the angles it makes at its junctions with respect to the x-axis 

are computed. The angle for each junction is computed by computing the hne formed from 
the junction and the fifth pixel in the curve segment fi*om that junction. If there are less 
15 than five pixels in the curve segment^ the angle is computed from the Hne formed from the 
junction and the other junction in the segment. The angles are used as a criterion for 
separating multiple seedlings. The length of each edge is calculated in pixel lengths, with 
one pixel length being added for pixels next to or on top of (N, S, E, or W to) the next 
pixel and V2 pixel lengths (approximately 1.414) being added for pixels at a diagonal to 

20 (NW, NE, SW, or SE to) the next pixel. The edge lengths are used to determine the 

primary axis of the skeleton, as a criterion for separating multiple seedlings, and ultimately 
to determine the hypocotyl length, the radicle length, and the total seedling length. 

Next, at task 244, the seedling analysis software of the present invention 
determines whether the skeleton consists of a single seedling or multiple seedlings. This 
25 preferably makes use of information about seed coats, cotyledons, or both seed coats and 
cotyledons. Preferably, information about seed coats and/or cotyledons is determined 
using a thresholding function similar to task 220 when the binary seedling image was 
generated. More specific to seed coats and cotyledons, the software performs two 

thresholding operations on the images, one with parameters directed toward seed coats and 

30 the other with parameters directed toward cotyledons. For specific plants, e.g., lettuce, the 
binary seed coat image is preferably generated with pixels meeting the following criterion 
being in the foreground: a red intensity of between 60 and 255, a green intensity of 

between 0 and 255 (any green intensity), and a blue intensity of between 0 and 100, For 

specific plants, e.g., lettuce, the binary cotyledon image is preferably generated with pixels 
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meeting the following criterion being in the foreground: a red intensity of between 200 
and 255, a green intensity of between 200 and 255, and a blue intensity of between 0 and 
200, These two binary images are then labeled using object labeling to generate a List of 
Objects data structure for each binary image, which are then filtered using the filter routine 
5 222 to filter out objects less than a certain pixel size, e.g., less than 10 pixels. The 

resulting binary seed coat image and binary cotyledon image have objects corresponding to 
seed coat objects and cotyledon objects, respectively, in the original scanned image. These 

seed coat objects and cotyledon images can be used to determine how many seedlings are 

present in each skeleton. 
10 Based on the assumption that there is one cotyledon object (actually a pair of 

cotyledons, wbicb appear as a single cotyledon object in the binary cotyledon image) and 
exactly one seed coat object for each seedling, the number of cotyledons/seed coats 
indicates the number of seedlings on the skeleton. However, in some seedlings only a 

cotyledon object is present (e.g., because the seed coat fell away from the cotyledon), in 
15 some seedlings only a seed coat is present (e.g., because the cotyledon has not emerged or 
remains covered by the seed coat), and in some seedlings both a seed coat and a cotyledon 
are present (e.g., because the cotyledon has partially emerged from the seed coat). 
Accordingly, sometimes a seed coat object and a cotyledon object are merged into a single 
object to indicate a cotyledon for a single seedling if they are close enough (e.g., within 10 
20 pixels). In the present implementation of the present invention, a List of Objects is created 
for each of the cotyledon binary image and the seed coat binary image. Not all the objects 
in the List of Objects representing seed coats, cotyledons, or seed coats and cotyledons are 
associated with the particular skeleton being analyzed. Bounding boxes expanded by a 
number of pixels, e.g., eight pixels, in aU four directions (e.g., x^m-S, x^^^^x+S, ymm-8, and 
25 Ymax^^) are used to associate the seed coat/cotyledon objects with each skeleton. That is, 
only seed coat/cotyledon objects in the Lists of Objects located completely within or 
partially within the expanded bounding box of that skeleton are associated with that 
skeleton. 
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Next, for each seed coat/cotyledon object in the Lists of Objects for that skeleton, 
the software determines the junction closest to the object. More specifically, for each 

cotyledon object, the junction closest to the center of the object is found (such a junction is 

called a cotyledon junction), where the center is defined as the center of the bounding box 
5 for the object. For each seed coat object, the junction closest to the center of the object that 
is within 10 pixels is foimd (such a j\mction is called a seed coat jimction); if no such 
junction exists, then the seed coat object is discarded from further processing. For each 
seed coat junction^ the existence of a nearby (e.g.^ within 10 pixels) cotyledon junction is 
checked. If there is a nearby cotyledon junction, the seed coat junction is discarded. This 
10 has the effect of marking a seed coat/cotyledon object as one cotyledon object when the 

cotyledon is only partially visible from the seed coat. After the above task is completed, 
the number of cotyledon junctions and the number of remaining seed coat junctions are 
added to represent the number of seedlings present in the seedling blob. There can be four 
cases: (1) the sum is zero, (2) the number of cotyledon junctions is one, but the number of 
15 seed coat junctions is zero, (3) the number of cotyledon junctions is zero, but the number 
of seed coat junctions is one, (4) the sum is two or greater. Case (1) represents the case 
where the seedling is missing a seed coat/cotyledon object, or the size/color of the object 
was rare that the thresholding did not pick it up. In this case it is assumed that there exists 
exactly one seedling in the seedling skeleton. Case (2) represents the case where the 

20 cotyledon is not covered by a seed coat. In this case, exactly one seedling is assumed in 

the seedling skeleton. Case (3) represents the case where the cotyledon is entirely covered 
by a seed coat. It is assumed that the seedling skeleton contains exactly one seedling in 
this case. Case (4) represents a case where there are multiple seedlings in the seedling 

skeleton. 

25 The following annotated pseudocode presents additional information on the 

determination of start junctions in each seedling skeleton (which is determined by task 
226), found in Listing 1 : 

cotimg contains the binary image of cotyledons, which was obtained by 
thresholding the original color image of the blotter and seedlings. 
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coatimg contains the binary image of seed coats, which was obtained by 

thresholding the original color image of the blotter and seedlings. 

minx is the minimum x coordinate of the bounding box of the seedling skeleton. 

maxx is the maximum x coordinate of the bounding box of the seedling skeleton, 
5 miny is the minimum y coordinate of the bounding box of the seedUng skeleton. 

maxy is the maximum y coordinate of the bounding box of the seedling skeleton. 

cotblobimg is cotimg cropped by the box (minx - 8, miny - 8, maxx + 8, maxy + 

8). 

coatblobimg is coatimg cropped by the box (minx - 8, miny - 8, maxx + 8, 
10 maxy + 8). 

cot info is the List of Objects extracted from cotblobimg that are larger than or 
equal to c_mincotsize in terms of the number of pixels. 

coatinf 0 is the List of Objects extracted from coatblobimg that are larger than 

or equal to c_mincoatsize in terms of the number of pixels. 
15 The software examines each seed coat to determine if that seed coat should be associated 
with a junction: 

for each object in coatinf o 

(coatx, coaty) = center of the bounding box for the 

object; 

20 the ID of the junction in coatinf o that is closest to 

(coatx, coaty) and within 10 pixels distance from (coatx, coaty) 
is added to coatindx; 
end for ; 

The software then examines each cotyledon to determine its associated junction: 
25 for each object in cotinfo 

(cotx, coty) = center of the bounding box for the 

object; 

the ID of the junction that is closest to (cotx, coty) 
is added to cotindx; 

30 end for; 
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The software then reconciles the junctions associated with seed coats and/or cotyledons: 
for each jxinction ID in cotindx 

cotjunction = junction identified by the junction ID in 

cotindx; 

5 for each junction ID in coatindx 

coat junction = junction identified, lay the jxinction 

ID in coatindx; 

if the distance between cotjunction and 
coatjunction is less than 10 
10 the ID of the coatjunction is removed from 

coatindx; 

end if; 

end for; 
end for ; 

15 

After the above steps, cotindx contains the junction ED's of the detected cotyledons, and 
coatindx contains the junction ID's of the detected seed coats. When a seed coat 
junction is close to a cotyledon junction, e.g., within 10 pixels, the seed coat junction is 
disregarded (i.e., absorbed into the cotyledon junction). The number of detected 

20 cotyledons and seed coats in the seedling skeleton can then be separated into the following 
four cases: 

Case 1 : If no cotyledon or seed coat was detected, assume the seedling skeleton 
contains exactly one seedling. 

Case 2: If one cotyledon was detected but no seed coat was detected, assume the 
25 seedling skeleton contains exactly one seedling. 

Case 3: If one seed coat was detected but no cotyledon was detected, assume the 
seedling skeleton contains exactly one seedling. 

Case 4: If the Usts of seed coat junctions and cotyledon junctions for this seedling 
skeleton does not fit either case 1, case 2, or 3, (which can be checked by adding the 
30 number of ID's in cotindx and the number of ID's in coatindx, and see if the sum is 
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greater than one) then the software assumes that the seedUng skeleton contains multiple 

seedlings (more specifically, the niimber of seedlings is determined to be the sum of the 
nimiber of ZD's in cotindx and the number of ID's in coatindx). 

The software now has determined enough about the seedling skeleton to determine 
5 the result of the branch task at 244, whether the seedling skeleton represents a single 

seedling or multiple seedlings. On the one hand, if the seedling skeleton was deteimined 

to be either Case 1, 2, or 3, then the skeleton is determined to be comprised of only a single 
seedling. Consequently^ the response to the question "Single Seedling?" at branch task 
244 in Figure 12 is "Yes" and the code branches to task 246 to analyze the skeleton as a 
10 single seedling. On the other hand, if the seedling skeleton was determined to be Case 4„ 
then that skeleton is determined to be comprised of multiple seedlings. Consequently, the 
response to the question "Single Seedling?" at branch task 244 in Figure 12 is "No" and 
the code branches to task 248 to analyze the skeleton as a multiple seedling. In either case, 

the next step is to determine the "primary axis" of each seedling, i.e., the path from the 
15 start junction down to the terminal junction of the primary (longest) root of the radicle, A 
single routine could be used to determine the primary axis of skeletons representing single 
seedhngs and skeletons representing multiple seedUngs. However, the branch at task 244 
allows the primary path detection routine for single seedlings to be optimized. 

Thus, if the skeleton represents a single seedling, the routine at 246 determines the 
20 primary axis of that single seedling. In the single seedling case, there are three subcases 
discussed earlier: (1) there are no cotyledon nor seed coat junctions, (2) there is one 
cotyledon junction but no seed coat junction, (3) there is one seed coat junction but no 
cotyledon junction. For Case 1, the shortest path is computed for each terminal junction to 
every other terminal junction to detect the primary axis of the seedling. The longest path is 
25 considered as the primary path. Since there is no information about which end junction of 
the primary path is the start junction (i.e., the junction that belongs to the cotyledon), 
whichever end junction that appears higher in the image (i.e., has a lower y coordinate, 
assuming the first, top scanline of the screen is y=0, the next scanline is y=l, etc.) is 

considered to be the start junction, For Case 2, the shortest path is computed from the 
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cotyledon junction to every other junction and the longest path is considered to be the 
primary axis. The start junction is the cotyledon junction. For Case 3, the primary axis is 
found by computing the shortest path from the seed coat junction to every other terminal 

junction. The longest path is considered to be the primary path. The start junction is the 

5 seed coat junction. 

This is based on the assumption that the seedling starts from a cotyledon and 
extends down to the tip of a single primary root, hi the alternative, for plants having a 
plurality of primary, secondary or seminal roots, the primary path routines of the present 
invention will need to determine a plurality of primary paths, e.g., by selecting the n longer 

10 shortest-paths or by determining a statistical value from all the calculated shortest-paths 
and selecting a number of longer shortest-paths above a determined value based on the 
statistical value of the shortest-paths. Referring back to the present implementation, given 
that the start junction is constrained as the cotyledon, the end point is the terminal junction 
farthest (in terms of path length) from the start junction. For the start junction and all the 

15 other terminal junctions (i.e., candidates for the end junction), there can be many, often 
infinite, ways to traverse the edges (paths). Thus, for each start junction/terminal junction 
pair, the shortest path is taken. Each jimction has a unique identifier associated therewith. 
Each path is represented by a series of junction identifiers. To find the shortest path from 
one node to every other node in a junction graph, a routine based on an algorithm 

20 presented in E. W. Dijkstra, "A Note on Two Problems in Connection with Graphs," 

Numerische Math, (1): 269-271 (1959) was used. Preferably, the longest of the shortest- 
paths is taken as the primary path, i.e., the primary axis of the seedling. The disadvantage 
of this implementation is that the primary axis for the seedling will not be correct when the 
seedling makes a large loop, because the shortest path will exclude the length of the loop. 
25 hi the alternative, the software can detect such loops and correct the shortest path 
accordingly. 

Having determined the primary path, i.e., the primary axis, of the seedling 
skeleton, the software next determines the hypocotyl/radicle separation point for the 
seedling skeleton, at 232 (Figure 12). The hypocotyl/radicle separation point is assumed to 
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be located at the upper most point in the seedling where the root hairs (or secondary roots) 

extend from the seedling. In terms of the junction graph of the seedling skeleton, the 

hypocotyl/radicle separation point is assumed to be located at the junction closest to the 
start junction (cotyledon terminal junction) that does not result in a hypocotyhradicle ratio 
5 (length of hypocotyl divided by length of radicle) that is too low, preferably set at 0,15. 
Thus, the routine at 232 selects a candidate junction, i.e., the junction in the primary path 
closest to the start junction, and calculates the lengths of the hypocotyl and radicle based 
on the assumption that that junction is the hypocotyl/radicle separation point (using the 

edge lengths in the junction graph). If the ratio of hypocotyl length to radicle length is 

10 0.15 or greater, then that junction is the separation point. If the ratio of hypocotyl length to 
radicle length is less than the value, e.g., 0.15, the software selects the next junction in the 

primary path of the skeleton and calculates the lengths of the hypocotyl and radicle based 
on the assumption that that junction is the hypocotyl/radicle separation point (using the 
edge lengths in the junction graph). Again, the ratio is determined and compared to the 
15 test value, e.g., 0.15, and either results in the determination of a proper separation point or 
the process repeats itself with the next junction in the primary path of the skeleton until a 

proper separation point is found (i.e., one that causes the length ratio to pass the test). 

Once a proper separation point is determined, the lengths of the hypocotyl and radicle are 
added together to calculate the total length of the seedling skeleton, as indicated at 250, 

20 and then the program at 252 either branches back up to perform routine 230 (Figure 12) 
again for the next seedling skeleton or returns to the code of Figure 11. 

Referring back to task 248, if the seedling skeleton was determined to comprise 
multiple seedlings at task 244, the software must account for the multiple seedling nature 
of that skeleton. Preferably, the software performs seedling separation, i.e., separates the 

25 multiple seedhngs into a plurality of single seedhngs, which can then be analyzed to 
determine their separation points, hypocotyl lengths, radicle lengths, and/or total lengths, 
etc. Preferably, the separation of seedhngs in skeletons representing multiple seedhngs is 
done by a routine comprising simulated annealing. A routine based in part on a separation 
algonthm hy H. Ni and iS. Gunasekaran, "A Computer Vision Method for Determining 
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Length of Cheese Shreds," Artificial InteUigence Review . 12: 27-37 (1998) and a 
simulated anneahng routine by S. Kirkpatrick, C. D. Gelatt, M. P. Vecchi, "Optimization 
by simulated annealing," Science 200(4598): 671-680 (1983) was used. 

Recall that from the routine at 244 (or Case 4 in the preceding pseudocode), the 
5 software has determined the number and location of the start junction (cotyledon or seed 
coat junction) for each of the multiple seedlings in the seedling skeleton. The software 
must next determine the primary path for each start junction, i.e., the primary path for each 
of the multiple seedlings. This is done by determining a number of possible paths and 

evaluating them. Because each start junction is connected to one or more other junctions, 

10 one of the other junctions can be selected and considered an extension of the seedling. By 
choosing another junction, then another, a sequence of junctions can be chosen, which in 
tvim defines a sequence of linear curve segments (edges). Any sequence of linear curve 
segments created this way can be considered a candidate for the structure of the seedling. 
Since this routine is directed at a junction graph representing multiple seedlings^ such a 

15 sequence of linear curve segments is created for each start junction, i.e., for each seedling. 
Each possible combination of all seedling structures (a candidate path for each and every 
start junction) is called a "configuration." Then, the seedling separation routine can 
evaluate each configuration of seedling paths and select the configuration determined to be 
the configuration that has correctly identified the paths of each seedling. Preferably, the 

20 seedling separation procedure is implemented as an energy minimization routine, with 

every configuration having a calculated energy value associated therewith, and the 
configuration having the lowest energy (or in the alternative the highest energy) is 
considered to be the correct configuration. That is, the "energy" is defined as a fimction of 
the configuration in such a way that a more desirable configuration has lower energy (or 
25 higher energy) than a less desirable configuration. The proper configuration is identified 
by an energy that is minimal as compared to all other configurations. In implementing this 
energy function and analysis, it is possible to create every possible configuration, compute 
the energy for each and every configuration, and search for the configuration that 
minimizes the energy. This brute force method can be accomphshed in a reasonable 
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computation time if the number of junctions and edges is relatively small, and/or if the 
processing capability of the computer unit 14 is relatively fast. However, the routine does 
not scale very well, because the search space is exponential, i.e., as the number of junctions 
and edges increases, the computation time to search the best configuration increases 
5 exponentially. Thus, preferably, a stochastic minimization method is used. More 
preferably, simulated annealing is used. Simulated annealing does not guarantee 
convergence to a global minimum (i.e., the most desirable configuration of all 
configurations), but simulated annealing does reach a very low energy configuration with 

high prohabihty, i.e., simulated annealing identifies a seedling path configuration that very 
10 likely contains a correct or very close to being a correct set of paths for each seedling. 
The preferred energy function used for this procedure is set forth as follows: 

CE(S,U) = j;^SE(s,) + Y.^ength(e) 

where SE is the energy for seedhng s;, Tst is the set of pair of junctions si on which a turn 
15 was made (ignoring turns on edges that are too short), Iseparation is an indicator function that 
evaluates to 1 when a hypocotyl/radicle separation exists for S; and 0 otherwise, S is the set 
of all seedlings in the seedling blob, U is the set of mused edges (i.e., edges not occupied 
by any seedlings), CE is the energy for a configuration with S and Z7, and Wangle, ^separation, 
and Wunused are constants. It was experimentally found that the following parameters yield 
20 satisfactory results: maximum number of annealing loop iterations = 50,000, Wangle = 200, 
^separation='200, Wunused = 10. Other valucs and wcights may provide satisfactory results and 
these values and weights (and other constants used herein) are preferably modifiable by the 
user to take into account user preference, analysis of different species, etc. 

The simulated aimealing routine starts with an initial configuration, preferably just 

25 the start jimction for each seedling. A random change to the configuration is proposed. 
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preferably a junction is added to one of the seedling paths, and the change is accepted 
immediately and that junction becomes part of the seedling path if the proposed 
configuration has a lower energy than the current configuration does. If the proposed 
configuration has a higher energy than the current configuration, then the proposed 

S configuration has a chance of being accepted or rejected. In the case where the proposal is 

rejected, then the current configuration remains unchanged. This process of configuration 
proposal, energy computation, and acceptance/rejection is repeatedly performed. After a 
number of iterations, a configuration in which the energy is very low should be reached. 

Thus, the ultimate goal of simulated annealing is to achieve a configuration that 

10 minimizes the energy in an attempt to find the most desirable configuration, without 
having to evaluate every possible configuration for that seedling skeleton. The formulation 
for the energy is a primary determining factor of desirable configurations in a problem 
setting. The "temperature" controls the probability that a change to the current 
configuration should be accepted. When the temperature is high, the probability of going 

15 to a higher-energy configuration can occur as frequently as going to a lower-energy 
configuration (thus very random); while at a low temperature, changes occur only if it 

decreases the energy (always downhill). 

More specific to the present implementation of the present invention, to define the 
seedling configuration energy, the following energy determination rules and heuristics are 
20 used. 

Rules: 

(1) A primary axis is a polyline (i.e., no branching is allowed). 

(2) A seedling cannot reuse one of its edges. 

(3) Multiple seedlings can share the same edge in the junction graph. 

25 (4) Edges can be left unused. 

Heuristics: 

(1) Primary axes do not make unnaturally sharp turns. 

(2) Edges in the junction graph should be used as much as possible. 

(3) It is desirable that all primary axes have a hypocotyl/radicle separation. 
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Each seedling has a start junction and an end junction, which is the current end of 
the path for that particular seedhng in the skeleton. Each proposed path has a fixed start 

junction and a varying end junction. Recall that the initial configuration preferably 
consists of only the start junctions (cotyledon terminal junctions) for the skeleton. 
5 Consequently, the start junctions initially are also the end junctions for each seedling. The 

following loop is performed to iteratively update the proposed seedling configuration: 

(a) Among all seedlings in the skeleton, randomly choose one seedling to update. 

(b) Determine the neighbor junctions of the end junction using the junction graph 
for that seedling. 

10 (c) Randomly choose a neighbor junction for that end junction. 

(d) If the chosen junction is already in the edge set for the seedling, then attempt to 
remove the jxmction from the seedling. 

(e) If the chosen junction is anything else, then attempt to add the jxmction to the 
seedling. 

15 (f) Decrease temperature and repeat until the maximum number of iterations is 

reached. 

Because junction computation is done at the pixel level, there may be junctions 
that are close together, which can cause a problem in tum angle calculation. For example, 
the angle of a tum created by three pixels, a pixel and its N and SE neighbors would be 
20 135°; however, the seedhng might not have made any significant tum at all at that point. 
To avoid this potential problem, the turns of edges that are not sufficiently long are 
ignored. In this implementation, preferably the turns on edges less than 10 pixels long are 
ignored. 

By the time the maximum number of iterations of the configuration update loop 
25 have been performed, the configuration should have the correct primary path for each 
seedhng. A maxunum number of iterations of 50,000 was found to yield satisfactory 
results. Each of the primary paths determined by the routine at task 248 is then processed 

by software routines 232 and 250 to determine the hypocotyl length, radicle length, and 
total length. 
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With that introduction, the following annotated pseudocode describes the seedling 

separation sofhvare, i.e., function SeparateSeedlings in Listing 1, in further detail: 

DATA STRUCTURES 

paths is a list of primary paths for aU seedlings. Because each primary path is represented 
5 by a list of junction identifiers, paths is a list of lists. Initially the path for each 

seedling contains only the start junction for that seedling. 
endAngle is a list whose i'th element is a hst of the angles formed by seedling i. 
Angles of edges are preferably measured with respect to the x-axis (with respect 
to the horizontal), so the angles between edges are calculated by subtracting the 
10 angle of edge from the angle of another. Thus, two parallel edges will have an 

angle of 0** between them. This data structirre does not store angles formed by 
turning onto edges that are shorter than minEdgeLength. 
pathlength is a list whose i'th element represents the total length of the present 

path of seedling i. 

15 RHseparation is a Ust whose i'th element represents the jimction identifier of the 
hypocotyl/radicle separation mark for seedling i. 
RHseparation2 is a list whose i*th element represents the junction identifier of the 
hypocotyl/radicle separation end. There are several differences between the 
junctions identified by RHseparation and RHseparation2. The junction 

20 identified by RHseparation is the first junction in a seedling's path that is at 

least 20 pixels away fi:om the start junction. The junction identified by 
RHseparation2 is the first junction in a seedling's path encountered after 
RHseparation that is at least 20 pixels away from RHseparation. If the 
first junction from is closer than 20 pixels from RHseparation, the software 

25 looks at consecutive junctions until the fu-st jimction that is at least 20 pixels 

from RHseparation is foxmd and assigns that junction to RHseparation2. 

Unless and until the software has determined both the RHseparation and 

RHseparation2, the software does not deem a seedling as having a 
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hypocotyl/radicle separation point, which is taken into account in the energy 
function. 

separationlen is the distance in pixels between the junctions identified by 
RHseparation and RHseparation2. 
5 edgeOccupation is a hst whose i'th element is a set of edges that are occupied by 
the i'th seedling. 

COMPUTING ENERGY FOR INITIAL CONFIGURATION 

The initial energy is set to the sum of the unused edge penalties for all edges, since 
10 no edges are occupied by any seedlings, and the penalty for not having determined any 
hypocotyl/radicle separation points yet: 
energy = 0; 

for each edge in junction graph 

energy = energy + unusedW * edge_length; 
15 end for; 

energy = energy + separationW * nuinber_of_seedlings; 
where imusedW is the weight (scalar) for unused edges, edge_length is the length 
of each respective edge, separationW is the weight for each seedling for which the 
hypocotyl/radicle separation point has not been determined, and 
20 nuinber_of_seedlings is the number of seedlings in the skeleton being analyzed. 

SIMULATED ANNEALING LOOP 

With this initial set-up, the following loop is performed loopmax number of times: 
seediD is set to the ID of the seedling that is randomly chosen to be updated. 
25 endjunc is set to current end jimction of the seedling seedlD. 

neighbors is the set of ID's all neighboring junctions to endjunc. The 
neighbors set includes the previous junction in the path, i.e., the junction in the 
path before endjunc. 

choice is the ID of a junction randomly chosen from neighbors. 
30 changeAngle is set to false 
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The particular junction randomly chosen to be choice greatly affects the execution 
of the code, in the sense that the junction chosen by choice can either extend the 
seedling path by one more junction or shorten the path by one junction. A different 

routine is executed if the j^revjows junction in the path is randomly chosen as compared 

5 to whether a subsequent junction is chosen, 

1 . choice is the same junction as the preceding junction to end j unc 
If choice is the same jimction as the preceding junction to end j unc, i.e., the 
software is backtracking back up the seedling path (shortening the path by one 
jimction), the software determines the energy benefit or energy penalty of removing the 
10 last junction and edge from the path for the current seedUng. Thus, the software 
computes the change in configuration energy (deltaEnergy) if the last junction/edge 
were to be removed from the primary path of that seedling: 
deltaEnergy =0; 

if removing the junction/edge results in hypocotyl/radiele 

15 separation to be removed, i.e., the point being removed is 
RHseparation2 meaning that removing this junction causes a 
hypocotyl/radiele separation point to be lost, for which there 
is a penalty 

deltaEnergy = deltaEnergy + separationW; 

20 end if; 

If removing this junction causes an angle to be changed and/or removed, there may be 

an energy change in response thereto: 

if edge_length > minEdgeLength, i.e., if the length of the 
edge being removed is less than a minimum edge length (e.g., 10 
25 pixels) , which allows us to preferably ignore the small edge 
because it might otherwise lead to erroneous angles being used 
in the energy function; 

if there are more than one element in endAngle for this 

seedling 

30 angle = angle formed by end j unc, choice, and the 

preceding junction to choice; 
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deltaEnergy = deltaEnergy - angleW * angle^2; 
end if; 

set changeAngle to true to indicate that removing this 

edge erases an angle; 

5 end if; 

If removing this junction causes an edge to become an unused edge, i.e., this seedUng 
is no longer using the edge and no other seedling is currently using this edge, there may 
be an energy change in response thereto: 

if the edge is no longer occupied after removal (no 

10 seedling contains the edge in their primary paths) 

deltaEnergy s deltaEnergy + unusedW * edge_length; 
end if; 

After determining the change in energy by the proposed removal of this junction, the 
change in energy is tested to determine if removing this junction was either (1) a 

15 change for the better, i.e., the change in energy was negative (deltaEnergy < 0), or 

(2) there was a positive increase in energy (removing this junction was a change for the 
worse). There is a chance that the change will be made anyway if the condition 
(exp (-deltaEnergy / (temper a tureConst * temperature)) > 
random_number_between(0, 1)) is satisfied, despite the fact that removing this 
20 junction would cause an increase in energy (which allows the routine to find the lowest 
energy configuration and not merely a local energy minimum). Such a random change 
is likely to occur when the temperature is high. The probability of this last expression 

being true (for any value of deltaEnergy) decreases with each iteration of the loop 

(because temperature decreases with every loop). If either of these conditions are 
25 true, the junction and edge are removed from the seedling path, the energy for the 

configuration is updated, the length of the seedling path is adjusted, and possibly an 

angle and/or the separation points, etc. are removed: 

if deltaEnergy < 0 or exp (-deltaEnergy / (temperatureConst 

* temperature) ) > randomnumberbetween (0,1) 
30 mark that choice no longer occupies the edge; 
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remove choice from the primary axis of the seedling; 

if changeAngle is true 

remove the last element from endAngle; 
end if; 

5 if choice is the hypocotyl/radicle separation mark 

(RHseparation) for the current seedling 

remove separation mark from the seedling; 
end if; 

if choice is the separation end point (RHseparation2) 
10 for the current seedling 

remove separation end point from the seedling; 
end if; 

subtract the edge length from the seedling path length; 
energy = energy + deltaEnergy; 
15 end if; 

2. choice is any other junction than the preceding junction to end j unc 

If choice is any other junction than the preceding junction to end j unc, i.e., the 
software is adding a new junction to the seedhng path (increasing the path by one 
20 junction), the software determines the energy benefit or energy penalty of adding this 

new junction and edge to the path for the current seedling. Thus, the software 
computes the change in configuration energy (deltaEnergy) if this new 
junction/edge were to be added to the primary path of that seedling: 
deltaEnergy ss 0 

25 The software computes the change in configuration energy (deltaEnergy) if the edge 
were to be added to the primary path: 

if the edge is not already occupied by any other seedling 

deltaEnergy = deltaEnergy - unusedW * edgeLength; 
end if; 
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Next, the software computes the change in configuration energy (deltaEnergy) 
associated with any identification of hypocotyl/radicle separation points or end points 

by the addition of this junction: 

if the current seedling does not already have a 
5 hypocotyl/radicle separation mark (RHseparation) 

if choice has more than 2 neighbors and the current 
seedling length is greater than 20 
newseparation = true; 
end if; 

10 elseif the current seedling has a separation mark (has 

RHseparation) but the separation is not complete (does not have 

RHseparation2) 

and if the length from the mark to choice is greater than 20, 
i.e.jr choice can be RHseparation2 
15 deltaEnergy = deltaEnergy - separationW; 

separationcomplete = true; 

endif 

Next, the software computes the change in configuration energy (deltaEnergy) 
associated with any change in angle caused by the addition of this junction: 
20 if edge_length > minEdgeLength i.e., if the length of the 

edge being removed is less than a minimum edge length (e.g., 10 
pixels) , which allows us to preferably ignore the small edge 

because it might otherwise lead to erroneous angles being used 
in the energy function; 
25 angle = angle formed by preceding junction to end junc, 

end j unc , choice ; 

deltaEnergy += angleW * angle'*'2; 

set changeAngle to true to indicate adding this edge 
will create an angle; 
30 endif; 

After determining the change in energy by the proposed addition of this junction, the 

change in energy is tested to determine if adding this junction to the path of this 
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seedling was either (1) a change for the better, i.e., the change in energy was negative 
(deltaEnergy < O), or (2) there was a positive increase in energy (adding this 
junction was a change for the worse). There is a chance that the change will be made 
anyway if the condition (exp( -deltaEnergy / (temperatureConst * 

5 temperature) ) > randoin_nximber_between (0,1)) is satisfied, despite the fact 
that adding this junction would cause an increase in energy (which allows the routine 
to find tlie lowest energy configuration and not merely a local energy minimum). Such 
a random change is likely to occur when the temperature is high. The probability of 
this last expression being true (for any value of deltaEnergy) decreases with each 
10 iteration of the loop (because temperature decreases with every loop). If either of 
these conditions are true, the junction and edge are added to the seedling path, the 
energy for the configuration is updated, the length of the seedling path is adjusted, and 

possibly an angle and/or the separation points, etc. are added: 

if deltaEnergy < 0 or exp ( -deltaEnergy / (temperatureConst 
15 * temperature)) > random_number_between(0,l) 

mark that this seedling has occupied by this seedling; 
add choice to the primary path of the current seedling; 
if changeAngle is true 

add angle to endAngle; 
20 end if; 

add the edge length to the seedling path length; 
if newseparation is true 

mark choice has the hypocotyl/radicle separation 
point (RHseparation) for the current seedling; 
25 set separation length of this seedling to the path 

length of this seedling; 
end if; 

if separationcomplete is true 

mark separation end point (RHseparation2) as 

30 choice; 

end if; 
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energy = energy + deltaEnergy; 
end if; 

Whatever happens in each iteration of the simulated anneaUng loop, the temperature 
is decreased to change the probability of accepting a proposal to change from the 
5 current configuration to a configuration having higher energy: 
temperature = 0.99 * temperature; 

END 

The result of the foregoing routine is a list of primary paths, one primary path for 
each of the seedlings separated, i.e., separately identified, by that routine. Each of the 

10 primary paths determined by the routine at task 248 is then processed by software routines 

232 and 250 to determine the hypocotyl length, radicle length, and total length. 

After the last seedling skeleton in the filtered List of Seedling Skeletons has been 
processed by the routine of Figure 12 to determine the hypocotyl length, radicle length, 
and total length, program control returns to task 234 to determine the seedling statistics and 
15 the vigor index for these this particular scanned blotter of seedlings. The vigor index is 
defined as follows: 

vigor = * growth * uniformity , 

growth = min(W;, * + * jIOOO) , 

uniformity = max(1000 - {w,, * s, + w,. * + w,,,,^ * s,^,^, + w,,, * s^,, ) - * numdead.O) 

20 

where If^ and are the sample averages (sample means) of the hypocotyl length and the 
radicle length, respectively, Sh, Sr, Stotah and Sr/h are the sample standard deviations of the 
hypocotyl length, radicle length, total length, and the ratio of the hypocotyl and radicle 
lengths, and the w's represent associated weights with the parameters being multiplied. 
25 The present implementation of the present invention uses the foUowing constants: 
wg = 0.7, wu = 0.3, Wk = 2,5, Wr ^ 5.0, w^- = 0.75, Wr- = 0.5, Wtotai = 2.5, and Wr/h = 50. 
Other weights will provide satisfactory results and these weights (and other constants used 
herein) are preferably modifiable by the user to take into account user preference, analysis 
of different species, etc. 
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The vigor index is divided into growth and uniformity parameters because seed 
analysts examine these to determine seed vigor. Each component has a minimum value of 
0 and a maximum value of 1000. The vigor index ranges from 0 to 1000 as it is a weighted 
average of the components, v^here weights range from 0 to 1 and sum to 1 . Weights can be 
5 adjusted to favor either growth or uniformity. Ideally, seedlings should be long and have 
uniform length. Since uniformity is a component of the vigor index, a uniformly dead 
sample can have a uniformity of 1000, and thus obtains a relatively high vigor index. This 
is not desirable. Thus, the software uses a penalty term in uniformity for dead seeds (seeds 
that were removed from fiirther processing by task 216) so that when a sample has all dead 
10 seeds, the uniformity is calculated as 0 instead of 1000. 

Next, a graphical overlay is determined from the seedling skeleton paths, at task 

236j and displayed along with the vigor index and other parameters at task 238. The 
graphical overlay is best explained with reference to Figure 9, which shows an image of 
the original scan of seedlings in the "Seedling Image" window, with red overlaid skeletons 

15 indicating where the software of the present invention determined the seedling hypocotyls 
to be and green skeletons indicating where the software of the present invention 
determined the seedling radicles to be. The overlay can be one pixel or several pixels in 
width. The point between the red and green overlays indicates the determined 
hypocotyl/radicle separation point for each seedling. 

20 Also in the display of Figure 9j there is a region for display of "Lidividual 

Measurements" for a particular seedling. If a user places the active point of a pointing 
device, e.g., places the active point of a cursor of a mouse 20, over one of the images of the 
one of the seedlings in the Seedling Image window, and actuates a switch of the pointing 
device, e.g., presses a button on the mouse 20, the software of the present invention 
25 displays in the "Individual Measurements" region the hypocotyl length, the radicle length, 
the total length, and the ratio for that particular seedling. 

While the present invention has been illustrated by the description of embodiments 
thereof, and while the embodiments have been described in considerable detail, it is not the 
intention of the apphcant to restrict or in any way limit the scope of the appended claims to 
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such detail. Additional advantages and modifications will readily appear to those skilled in 

the art. For example, the present implementation of the present invention has been 
optimized for lettuce plants and should function with little or no modification on other 

plants with similar seedlings, e.g., certain irapatiens or soybeans. Seedlings of other plants 

5 can be analyzed using the teachings and benefits of the present invention with certain 
modifications to the code described herein. Therefore, the invention in its broader aspects 
is not limited to the specific details, representative apparatus and method, and illustrative 
examples shown and described. Accordingly, departures may be made from such details 

without departing firom the spirit or scope of the apphcant's general inventive concept. 
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We claim: 


1 1. A method of automatically analyzing at least one seedling germinated from at least one 

2 seed, comprising the steps of: 

3 (a) capturing a digital image of the at least one seedling; 

4 (b) identifying the at least one seedling in the captured digital image; 

5 (c) determining a primary path of the at least one seedling; 

6 (d) determining at least one value from the primary path of the at least one seedling; 

7 and 

8 (e) determining a seed vigor index from at least the at least one value determined 

9 from the primary path of the at least one seedling. 

1 2. The method of automatically analyzing at least one seedling according to claim 1 : 

2 (a) v^herein said step of determining at least one value from the primary path of the at 

3 least one seedling comprises the step of determining a value corresponding to an 

4 overall length of the at least one seedling from the primary path of the at least one 

5 seedling; and 

6 (b) wherein said step of determining a seed vigor index from at least the at least one 

7 value determined from the primary path of the at least one seedling comprises the step 

8 of determining a seed vigor index from at least the value corresponding to the overall 

9 length of the at least one seedUng. 

1 3 . The method of automatically analyzing at least one seedling according to claim 1 fiuther 

2 comprising the step of determining a separation point between the hypocotyl of the at least 

3 one seedling and the radicle of the at least one seedling; and: 

4 (a) wherein said step of determining at least one value from the primary path of the at 

5 least one seedling comprises the step of determining a value corresponding to the 

6 length of at least one of the hypocotyl of the at least one seedling and the radicle of the 

7 at least one seedling; and 
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8 (b) wherein said step of determining a seed vigor index from at least the at least one 

9 value determined from tke pnmary path of tke at least one seedling comprises the step 

10 of determining a seed vigor index from at least the value corresponding to the length 

11 of at least one of the hypocotyl of the at least one seedling and the radicle of the at 

12 least one seedling. 

1 4. The method of automatically analyzing at least one seedling according to claim 1 further 

2 comprising the step of determining a separation point between the hypocotyl of the at least 

3 one seedhng and the radicle of the at least one seedling; and: 

4 (a) wherein said step of determining at least one value from the primary path of the at 

5 least one seedling comprises the step of determining a hypocotyl length value 

6 corresponding to the length of the hypocotyl of the at least one seedling and a radicle 

7 length value corresponding to the length of the radicle of the at least one seedling; and 

8 (b) wherein said step of determining a seed vigor index from at least the at least one 

9 value determined from the primary path of the at least one seedling comprises the step 

10 of determining a seed vigor index from at least the hypocotyl length value and the 

1 1 radicle length value. 


1 5. The method of automatically analyzing at least one seedling according to claim 1 

2 wherein said step of determining a primary path of the at least one seedling comprises the step 

3 of determining a locus of pixels, the locus of pixels corresponding to the primary path of the 

4 at least one seedling and the locus of pixels being narrower in width than the width of the at 

5 least one seedling in the digital image of the at least one seedling. 

1 6. The method of automatically analyzing at least one seedling according to claim 1 

2 wherein said step of determining a primary path of the at least one seedling comprises the step 

3 of determining a locus of pixels, the locus of pixels corresponding to the primary path of the 

4 at least one seedling and the locus of pixels being a predetermined number of pixels in width. 
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1 7. The method of automatically analyzing at least one seedling according to claim 1 

2 wherein said step of determining a primary path of the at least one seedUng comprises the step 

3 of determining a locus of pixels, the locus of pixels corresponding to the primary path of the 

4 at least one seedhng and the locus of pixels being one pixel in width. 

1 8. The method of automatically analyzing at least one seedling according to claim 1 further 

2 comprising the step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling, and 


4 (a) wherein said step of determining a primary path of the at least one seedling 

5 comprises the step of determining a primary path for each of the separately identified 

6 overlapped seedlings; 

7 (b) wherein said step of determining at least one value from the primary path of the at 

8 least one seedling comprises the step of determining from the primary path for each of 

9 the separately identified overlapped seedlings a value corresponding to an overall 

10 length of that separately identified overlapped seedling; and 

1 1 (c) wherein said step of determining a seed vigor index from at least the at least one 

12 value determined from the primary path of the at least one seedling comprises the step 

13 of determining a seed vigor index from at least the plurahty of values determined in 

14 step (b). 

1 9. The method of automatically analyzing at least one seedling according to claim 1 further 

2 comprising the step of separately identifying a plurality of overlapped seedlings in the digital 

3 image ofthe at least one seedling, and 

4 (a) wherein said step of determining a primary path of the at least one seedling 

5 comprises the step of determining a primary path for each of the separately identified 

6 overlapped seedlings; 
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7 (b) wherein said step of determining at least one value from the primary path of the at 

8 least one seedling comprises the step of determining from the primary path for each of 

9 the separately identified overlapped seedlings a value corresponding to the length of at 

10 least one of the hypocotyl of that separately identified overlapped seedling and the 

1 1 radicle of that separately identified overlapped seedling; and 

12 (c) wherem said step of determining a seed vigor index from at least the at least one 

13 value determined from the primary path of the at least one seedling comprises the step 

14 of determining a seed vigor index jfrom at least the plurality of values determined in 

15 step (b). 

1 10. The meihod of automatically analyzing at least one seedling according to claim 1 fiirther 

2 comprising the step of separately identifying a pluraUty of overlapped seedUngs in the digital 

3 image of the at least one seedling, and 

4 (a) wherein said step of determining a primary path of the at least one seedling 

5 comprises the step of determining a primary path for each of the separately identified 

6 overlapped seedlings; 

7 (b) wherein said step of determining at least one value from the primary path of the at 

8 least one seedling comprises the step of determining from the primary path for each of 

9 the separately identified overlapped seedlings a hypocotyl length value corresponding 

10 to the length of the hypocotyl of that separately identified overlapped seedling and a 

11 radicle length value corresponding to the length of the radicle of that separately 

12 identified overlapped seedling; and 

13 (c) wherein said step of determining a seed vigor index from at least the at least one 

14 value determined from the primary path of the at least one seedhng comprises the step 

15 of determining a seed vigor index from at least the plurality of hypocotyl length 

16 values determined in step (b) and at least the plurality of radicle length values 

17 determined in step (b). 
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1 11. The method of automatically analyzing at least one seedling according to claim 8 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy function. 

1 12. The method of automatically analyzing at least one seedling according to claim 9 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy function, 

1 13, The method of automatically analyzing at least one seedling according to claim 10 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy fimction. 

1 14. The method of automatically analyzing at least one seedling according to claim 8 

2 wherein said step of separately identifying a pluraUty of overlapped seedlings in the digital 

3 image of the at least one seedUng comprises evaluating an energy fimction based on proposed 

4 configurations of at least partial primary paths of overiapped seedlings. 

1 15. The method of automatically analyzing at least one seedling according to claim 9 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy function based on proposed 

4 configurations of at least partial primary paths of overlapped seedlings. 

1 16. The method of automatically analyzing at least one seedling according to claim 10 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy function based on proposed 

4 configurations of at least partial primary paths of overlapped seedlings. 

1 17. The method of automatically analyzing at least one seedling according to claim 8 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 
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3 image of the at least one seedling comprises evaluating an energy function based on proposed 

4 configurations of at least partial primary paths of overlapped seedlings using the following 

5 heuristics: primary paths do not make urniaturally sharp turns and seedling edges should 

6 be used as much as possible. 

1 18. The method of automatically analyzing at least one seedhng according to claim 9 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy function based on proposed 

4 configurations of at least partial primary paths of overlapped seedlings using the following 

5 heuristics: primary paths do not make unnaturally sharp tums and seedling edges should 

6 be used as much as possible, 

1 19. The method of automatically analyzing at least one seedling according to claim 10 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy function based on proposed 

4 configurations of at least partial primary paths of overlapped seedlings using the following 

5 heuristics: primary paths do not make unnaturally sharp tums and seedling edges should 

6 be used as much as possible. 

1 20. The method of automatically analyzing at least one seedling according to claim 8 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy fimction based on proposed 

4 configurations of at least partial primary paths of overlapped seedUngs using the following 

5 heuristics: primary paths should not make unnaturally sharp turns, seedling edges should 

6 be used as much as possible, and all primary axes should have a hypocotyl/radicle 

7 separation point. 
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1 21. The metihod of automatically analyzing at least one seedling according to claim 9 

2 wherein said step of separately identifying a plurality of overlapped seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy function based on proposed 

4 configurations of at least partial primary paths of overlapped seedlings using the following 

5 heuristics: primary paths should not make unnaturally sharp tums, seedling edges should 

6 be used as much as possible, and all primary axes should have a hypocotyl/radicle 

7 separation point. 

1 22. The method of automatically analyzing at least one seedling according to claim 10 

2 wherein said step of separately identi:fying a plurality of overlapped, seedlings in the digital 

3 image of the at least one seedling comprises evaluating an energy fimction based on proposed 

4 configurations of at least partial primary paths of overlapped seedlings using the following 

5 heuristics: primary paths should not make unnaturally sharp turns, seedling edges should 

6 be used as much as possible, and all primary axes should have a hypocotyl/radicle 

7 separation point. 

1 23, The method of automatically analyzing at least one seedling according to claim 1 further 

2 comprising the steps of determining a first locus of points indicating the hypocotyl of the at 

3 least one seedling, determining a second locus of points indicating the radicle of the at least 

4 one seedling, overlaying the first and second loci over an image of the seedlings to generate a 

5 composite image, and displaying the composite image. 

1 24. The method of automatically analyzing at least one seedling according to claim 23 

2 wherein said step of displaying the composite image comprises the step of displaying the 

3 composite image on a video display terminal 
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1 25. The method of automatically analyzing at least one seedhng according to claim 23 

2 wherein said step of displaying the composite image comprises the step of printing the image 

3 on a printer or plotter. 

1 26. A method of automatically analyzing at least one seedling germinated from at least one 

2 seed, comprising the steps of: 

3 (a) capturing a digital image of the at least one seedling; 

4 (b) determining a first locus of points indicating the hypocotyl of the at least one 

5 seedling; 

6 (c) determining a second locus of points indicating the radicle of the at least one 

7 seedling; 

8 (d) overlaying the first and second loci over an image of the seedlings to generate a 

9 composite image; and 

10 (e) displaying the composite image. 

1 27. A method of analyzing at least one seedling germinated from at least one seed, 

2 comprising the steps of: 

3 (a) placing a growing medium in a shallow container; 

4 (b) wetting the growing medium; 

5 (c) placing the at least one seed onto the growing medium; 

6 (d) germinating the at least one seed with the shallow container at an angle with 

7 respect to the vertical that is less than about 10°; 

8 (e) capturing a digital image of the at least one seedling; and 

9 (f) analyzing the captured digital image ofthe germinated seedling. 

1 28. The method of analyzing at least one seedling according to claim 1 wherein said step of 

2 germinating the at least one seed with the shallow container at an angle with respect to the 
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3 vertical that is less than about 10** comprises the step of positioning the shallow container 

4 vertically. 

1 29. The method of analyzing at least one seedling according to claim 1 wherein said step of 

2 capturing a digital image of the at least one seedling comprises capturing an image of the at 

3 least one seedling using a scanner having a scanner surface and positioned with its scanner 

4 surface oriented at least 90*" from the horizontal, 

1 30. The method of analyzing at least one seedUng according to claim 1 wherein said step of 

2 capturing a digital image of the at least one seedling comprises capturing an image of the at 

3 least one seedling using a scanner having a scanner surface and positioned with its scanner 

4 surface substantially inverted so that it captures an image of at least one seedling positioned 

5 beneath the scanner. 
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ABSTRACT 

A system and method for automatically detemiining a seed vigor index for a lot of 

seeds by analysis of a scanned image of a plurality of seedlings grown from lot of seeds, 

including automatically separating and analyzing overlapped seedlings. According to one 
5 aspect of the current invention, seedling analysis software is used to analyze an image of 
seedlings. The seedling analysis software preferably analyzes both hypocotyl and radicle 
lengths and thus determines the separation point between the two for each seedling. The 
seedling analysis software also preferably separates overlapped seedlings^ preferably using a 
simulated annealing technique. According to another aspect of the present invention, a low- 
10 cost scanner placed in an inverted configuration in a scanner enclosure is used to generate 

high-quality, reproducible images of seedlings. According to yet another aspect of the present 
invention, a method of using ordinary germination boxes, i.e., "sandwich boxes" is used to 
germinate seedlings that greatly facilitate computer-based analysis, hi general, this method 

comprises placing germination blotter paper in the lid of a sandwich box and growing 
15 seedlings within the sandwich box in a nearly vertical (upright) position in a darkened 
germination chamber. The resulting seedlings produce hypocotyls that grow essentiaUy 
upward and radicles that grow essentially downward, which greatly facilitates image 
acquisition of the entire seedUng, e.g., with an inverted scanner. 
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// SeedlingAnalyzer . cpp : implementation of the SeedlingAnalyzer class. 
// 

////////////////////////////////////////////////////////////////////// 

#include "stdafx.h" 
#include "Progeny .h" 
#include "SeedlingAnalyzer . h." 

#include "ProgenyDoc . h" 

#include "ColorConversion . h" 

#include "const .h" 

#include <math.h> 
#include <f stream. h> 

#ifdef __DEBUG 

Sundef THIS_FILB 

static char THIS_FILE[]= FILE ; 

#def ine new DEBUG_NEW 

#endif 

;^^|de£ine GETRAND (randO / (double) (RMrD_MAX+l) ) 

iP///////////////////////////////////////////////////////////////////// 

/ Cons t rue tion/Dest rue t ion 
^7///////////////////////////////////////////////////////////////////// 

^::deedlingAnalyzer : : -SeedlingAnalyzer () 

[1 


i:^/ Returns information needed to measure radicle and hypocotyl lengths on 

each seedling detected from a color image of seedlings, 
p^td : : vector<SeedlingInf o *> SeedlingAnalyzer :: ProcessSeedlinglmage ( ImagelO* image) 

// Minimum pixel area for a blob to be qualified as a seedling blob 

const int c_minblobsize = 100; 

// kernel size used for median filtering 

const int c_iiieclkernelslze = 3; 

// Minimum skeleton length to be qualified as a seedling blob 
const int c_minseglen = 15; 

// Minimum size for a blob to be considered as a cotyledon 
const int c_mincotsize = 10; 

// Minimum size for a blob to be considered as a seed coat 
const int c_mincoatsize = 10; 

// Seedling separation parameters 

const float c_angleW = 200. Of; 

const float c_initialTemperature - 2 0 00. Of; 

const float c_lengthW = O.Of; 

const int c_maxIteration = 50000; 

const float c_temperatureConst = l.Of; 

const float c_unusedw = 10. Of; 

const float c_minEdgeLength = 10. Of; 

const float c_separationW = 200. Of; 

// Data structure to hold extract measurements of seedlings 
std: : vector<SeedlingInf o *> seedlinginf o; 
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// origimg is the original RGB image of seedlings. 
Eximage* origimg = (Eximage*) image; 

// Create binary image of cotyledons (leaves) 

Eximage* cotimg = origiing->Threshold(200, 255, 200, 255, 0, 200); 

// Create binary image of seed coats 

Eximage* coatimg = origimg- >Threshold (60 , 255, 0, 255, 0, 100); 
// Binary threshold based on red channel 

// To threshold, find the peak intensity on the red channel by PindPeakValue (0) . 

// The peak intensity + 4 0 is a good lower bound for thresholding. 

Eximage* binimg = origimg- >Threshold (origimg->FindPeakValue (0) +40 , 255, 0, 255, 0 

255) ; 

// Remove blobs of size less than c_minblobsize 

BinaryObjects* binobjs = binimg- >Get0bj ects () ; 

delete binimg; 
O binobj s->FilterOut (c_minblobsize) ; 

■,n Eximage* cleanbinimg = binobj s->CreateImage () ; 

In delete binobj s; 

M // Perform median filtering to remove noise and smooth out edges 

Eximage* smoothimg = cleanbinimg- >MedianFilter (c_medkernelsize) ; 

ry BinaryObjects* smoothobjs = smoothimg- >GetObj ects () ; 

Q std : :vector<0bjectlnfo*> blobobjinfo = smoothobj s- >GetObj ectinf o ( ) ; 

// 4. Perform thinning (skeletonization) 
Eximage* thinimg = smoothimg->Thin () ; 

delete smoothimg; 

// Throw out skeletons of length less than c__minsegln 
BinaryObjects* binskel = thinimg- >Get0bj ects () ; 
delete thinimg; 

binskel- >FiltGrOut (c_minseglGn) ; 

// objinfo holds information for all detected objects in the 
/ / skeletonized image . 

Std: :vector<ot)jectlnfo*;> otojinfo = binskel- ;>GetOb] ectinf o () ; 

// since the extracted skeleton contains root hairs and other 
// noise, use the shortest path algorithm to find the primary 
// axis. Also, the second junction in the path is the hypocotyl 

// separation, if it is not the end junction (i.e., not tiie bottom). 

ShortestPathFinder spf; 

ConnectivityGraph<Edge *>* jg; // Junction graph. 

bool added = false; // True if seedlinginfo was updated, 

// Perform the following loop for each seedling blob 
for{i=0; i<objinfo.size() ; i++) 

( 
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// Compute the junction graph for the seedling blob 

std; :vector<Junction*> jlist; 

jg = binskel- >CreateJ'unctionGraph (obj inf o [i] , jlist); 

//A seedling blob has to have more than 2 junctions 
// to be considered for further processing 

if (jlist. sizeO > 1) 

{ 

// Find the cotyledon junction. 

// Find cotyledons and leaves in the current blob. 

Eximage* cotblobimg = cotimg->Crop (max (0, obj info [i] ->xmin-8) , 

max { 0 , obj info [i] - >ymin-8 ) , 

min(origimg->GetWidth{) -1, obj info [i] ->xmax+8) , min(origimg- 
>GetHeight 0 -1, obj info [i] ->ymaxt8) ) / 

Eximage* coatblobimg = coatimg->Crop (max (0 , obj inf o [i] ->xmin-8) , 
,,niax {0 , obj info [i] - >ymin-8) , 

4 inin(originig->GetWidth() -l,ob]info[i] ->xmax+8) , min(origimg- 

^^GetHeight () -1, objinf o [i] ->ymax+8) ) ; 

."^ // Throw out blobs of size less than c_mincotsize 

1 1 cotinf o contains information for all extracted cotyledon 

// blobs greater than or equal to cjnincotsize 

BinaryObjects* cotobjs = cotblobimg- >GetObj acts () ; 
delete cotblobimg; 

□ cotobjs ->FilterOut (c_mincotsize) ; 

in std: : vector<0bjectln£o*> cotinfo ~ cotobj s->GetObjectInf o () ; 

// Throw out blobs of size less than c_mincoatsize 

3, // coatinfo contains information for all extracted seed coat 

□ // blobs greater than or equal to c_mincoatsize 

BinaryObjects* coatob j s = coatblobimg- >GetObj ects () ; 

delete coatblobimg; 

coatobj s->FilterOut (c_mincoatsize) ; 

std: :vector<0bjectlnfo*> coatinfo = coatobj s->GetObjectInfo () ; 

// coatindx holds id of seed coat junctions 
std: :vector<int> coatindx; 

// Find the junction (in junction graph) that corresponds to seed coats 

for(int c=0; c<coatinf o. size () ; C++) 

{ 

// Since objects were extracted from a cropped image, add offset 
int coatx = max(0, objinfo [i] ->xmin-8) + (coatinfo [c] ->xmax + 


coatinfo [c]->xmin)/2; 

coatinfo [c] ->ymin) /2 ; 


int coaty ^ max (0 , obj inf o [i] ->ymin-8) + (coatinfo [c] ->ymax + 

float mindist = 1000000. Of; 
int minindx - -1; 

// Loop through each junction in the junction graph to 
// find the closest junction to the current seed coat 
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for(int j=0; j <j list . size () ; j++) 

{ 

Junction* junc = jlist[j]; 

int dist = (coatx - junc->Tn_x) * (coatx - junc->m_x) + 
(coaty - junc->Tn_y) * (coaty - junc->m_y) ; 

// the closest junction must be less than 10 pixels away 


from the seed coat blob 


if ((dist < mindist) && (dist < 10*10)) 
{ 

mindist = dist; 

minindx = j; 

} 

} 

// if such a seed coat is found, add it to coatindx 
if (minindx >= 0) 

{ 

coatindx .push_back (minindx) ; 

} 


// cotindx holds id of seed coat junctions. 

std: :vector<int> cotindx; 

// Find the junction that corresponds to cotyledons. 
for(c=0; c<cotinf o. size 0 ; C++) 

{ 

cotindx.push__back(-l) ; 

// Since objects were extracted from a cropped image, add offset. 

int cotx = max(0,ob]info[i] ->xniin-8) + (cotinfo[c] ->xmax + 

int coty = max (0 , obj info [i] ->ymin-8) + (cotinfo [c] ->ymax + 

TRACES ("blob %d: cotx=%d, coty=%d\n" , i, cotx, coty) ; 
float mindist = 1000000. Of; 

// Loop through each junction in the junction graph to 
// find the closest junction to the current cotyledon 
for(int j=0; j <j list . size () ; j++) 

{ 

Junction* junc = jlist[j]; 

int dist = (cotx - junc->m_x) * (cotx - junc->m_x) + (coty 
- junc->m__y) * (coty - junc->m_y) ; 

if (dist < mindist) 

{ 

mindist = dist; 
cotindx [c] = j; 

} 

) 

} 

// Each seed coat that is close enough to a cotyledon is merged to the 

cotyledon 

for(int cot=0; cot<cotindx.siz6() ; cot+4-) 


'igotinf o [c] ->xmin) /2 ; 
l^potinf o [c] ->ymin) /2 ; 
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{ 

for(int coat=0; coat<coatindx. size { ) ; coat++) 

{ 

// if junctions are within 10 pixel distance, tlien drop the 

coat junction. 

float sqdist = pow (j list [cotindx [cot] ]- >m_x - 

] list [coatindx [coat] ]->in_x, 2) + 

pow (j list [cotindx [cot] ] ->m_y - j list [coatindx [coat] ] - 

>m_y, 2) ; 

if(sqdist < 10.0f*10.0f) 

{ 

coatindx. erase (coatindx . begin ( ) +coat) ; 
coat-- ; 

} 


) 

// Free memory 

for(int obj=0; obj <cotinfo . size () ; obj+H-) 
C3 delete cotinf o [obj ] / 

// Free memory 

for(obj=0; obj <coatinfo. size 0 ; obj ++) 
delete coatinf o [obj ] ; 

i^y // primaryAxes holds a primary axis for each detected seedling 

j y JJ in the current seedling blob 

std: : vector<std : : vector<int> > primaryAxes; 

rri II If no cotyledon/ seed coat was detected, 

Q // assume the seedling blob contains only one seedling 

if { (cotindx. size {) == 0) && (coatindx . size () == 0)) 

:S // Find the longest shortest path to find the primary axis 

float maxdist = O.Of; 

int maxindxl = -1, maxindx2 = -1; 
for(int 3c=0; k< jg->GetSize () ; 
{ 

std: :vector<float> dist = spf .FindShortestPathDistance (*jg. 


k) 


for(int m=0; m<dist . size () ; m++) 

{ 

if (maxdist < dist [m] ) 

{ 

maxdist = dist [m] ; 
maxindxl = k; 
maxindx2 = m; 

} 

} 

} 

ASSERT ( (maxindxl 1= -1) (maxindx2 -1) ) ; 

// Since no information is given on which end junction belongs 

// to a cotyledon, find out which index is top/bottom, 

// Assume the top junction belongs to a cotyledon, 
int yl = j list [maxindxl] ->m_y; 
int y2 = j list [maxindx2 ] - >m_y ; 
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if (yl > y2) 
{ 

int temp = maxindxl/ 

maxindxl = maxincix:2 ; 

maxindx2 = temp; 

} 

primaryAxes .push_back (gpf . PindShortestPafch (*jg, maxindxl , 

} 

// If a cotyledon was detected but no seed coat, find the shortest 
// path from the cotyledon junction to every other junciton, 
// and take the longest path as the primary axis 

else i£ ( (cotindx. size () === 1) (coat indx . size () ==0) ) 

{ 

std: :vector<float> dist = spf . FindShortestPathDistance (* jg. 


int maxindx = -1; 
float maxdist = -l.Of; 

for(int m=0; m<dist . size () ; m++) 

{ 

if (maxdist < dist [m] ) 
{ 

maxdist = dist [m] ; 

maxindx = m; 

} 

} 

ASSERT (maxindx i>= 0); 

int yl = j list [cotindx [0] ] ->m_y; 
int y2 = j list [maxindx] - >m_y; 

int indxl , indx2 ; 

if (yl > y2) 
{ 


} 

else 

{ 


indxl = maxindx; 
indx2 = cotindx [0]; 


indxl = cotindx [0]; 
indx2 = maxindx; 


} 

pirimaryAxes.push_back(sp£.Pind5hort6sfcPat]i(*]g, indxl, indx2)); 

} 

// If there is one seed coat and no cotyledon, assume one seedling 
// within the blob 

else i£ ( (coatindx. size () == 1) && (cotindx . size () ==0 ) ) 

{ 

// Find the longest shortest path. 

std: :vector<f loat> dist = spf .FindShortestPathDistance (*jg, 


6 


Listing 1 


int maxindx = -1/ 
float maxdist = -l.Of; 


for (int m=0; m<dist . size () ; m++) 

{ 

if (maxdist < dist [m] ) 

( 

maxdist = dist [m] ; 
maxindx = m; 

} 

} 

ASSERT (maxindx >- 0) ; 

int yl - j list [coat indx [0] ]- >m_y; 
int y2 = j list [maxindx] - >m__y; 

int indxl , indx2 ; 

■^i if (yl > y2) 

indxil = maxindx; 
indx2 = coat indx [0]; 

t } 

else 

M { 

^ indxl = coatindx[0]; 

^ indx2 = maxindx; 

i ^ 

tj primaryAxes .push_back (spf . FindShortestPath (* jg, indxl, indx2) ) ; 

a } 

□ // This is the case where there are multiple cotyledons in the blob 

else if (coatindx . size ( ) + cotindx . size ( ) > 1) 

{ 

std! :vector<int> startjuncs; 

for(int c-0; c<coatindx . size () ; C++) 

start juncs .push_back (coatindx [c] ) ; 
for(c=0; c<cotindx. size 0 ; C++) 

start juncs .push_back (cotindx [c] ) ; 

// Obtain primary axis for each seedling in the blob 
primaryAxes = SeparateSeedlings ( jg, startjuncs, c_maxIteration, 

c_lengthW, c_angleW, c_unusedW, c_initialTemperature, c_temperatureConst , 

c_minEdgeLength, c_separationW) ; 

T 

// Perform hypocotyl/ radicle separation on each seedling found in the 

blob 

J J The first junction encountered while traversing the primary path 

from the 

// cotyledon junction that separates the seedling into hypocotyl and 

radicle such that 

// hypocotyl : radicle length ratio is no less than 0.15 
// is the separation point 

for(int s=0; s<primaryAxes,size() ; stt) 

{ 
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if (primaryAxes [s] . size 0 > 1) 
{ 

int k = 1; 

Seedlinglnfo* sinfo = new Seedlinglnfo; 

sinf o->hypocotyl_lengtli = j g- >Get Edge (primaryAxes [s] [k-ll , 

primaryAxes [s] [k] ) -?>m_length,' 

sinf o- >radicle_lengt:h. = 0; 

for (int j <primaryAxes [s] . size ( ) - 1 ; 

{ 

sinf o->radicle length += jg- 
>GetEdge (primaryAxes [s] [j] , primaryAxes [s] [j+l] ) ->m_length; 

) 

// Check to see if hypocotyl/radicle ratio is not so 

extreme . 

// If SO, extend hypocotyl and shorten radicle. 
k++; 

while ( ( (float) sinf o->hypocotyl__length / sinf o- 
;^|radicle_length < 0.15) && (primaryAxes [s] .size 0 > k)) 

sinfo- >hypocotyl_length += jg- 
^as^GetEdge (primaryAxes [s] [k-1] , primaryAxes [s] [k] ) ->m_length; 
-,.5 sinf o->radicIe_length -= jg- 

l;UGetEdge (primaryAxes [s] [k-l] , primaryAxes [s] [k] ) ->m_length; 
ry k++; 

L ^ 

rn sinf o->hyporad_separat ion = k - 1; 

sinfo->primary_axis = primaryAxes [s] ; 
sinfo- >junction_graph = jg; 

.™ // Compute the bounding box for the seedling 

int xmin = 1000000, xmax = -1, ymin = 1000000, ymax = -1; 
for(int m=0; m<primaryAxes [s] . size () -1; m++) 

{ 

Edge* edge = jg->GetEdge (primaryAxes [s] [m] , 


primaryAxes [s] [m+1] ) 


if (edge->m_xmin < xmin) 

xmin = edge - >m_xmin ; 
i f ( edge - >m_xmax > xmax) 

xmax = edge - >m_xmax ; 
i f ( edge - >m_ymin < ymin) 

ymin = edge->m__ymin; 
i f ( edge - >m_ymax > ymax ) 

ymax = edge - >m_ymax ; 

} 

sinf o->toplef t .X = xmin; 
sinfo->toplef t .y = ymin; 
sinfo->bottomright .x = xmax; 
sinf o- >bottomright .y = ymax; 

seedlinglnfo. push_back (sinfo) ; 
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added = true; 

} 

} / / 2.t there is one cotyledon in the blob 

1 //if there are more than one junctions 

if ( I added) 

delete jg; 

else 

added = false/ 

} 

// In case cotyledon/hypocotyl separation was undetected, 
// assume separation point at the mean ratio. 

for(int i=0; i<seedlinginf o . size ( ) ; i++) 

{ 

if (seedlinginf o [i] ->hyporad_separation == 0) 

{ 

seedlinginf o [i] ->useAverageSeparation = true; 

} 

Iff // Free memory. 

delete cotimg; 
delete coatimg; 

ri; return seedlinginf o; 

I 

r^/ Separate seedlings using simulated annealing. 

pStd: :vector<std: :vector<int> > SeedlingAnalyzer : : SeparateSeedlings (Connect ivityGraph<Edge 
,g>* j graph, std: :vector<int> startjunc, 

fk!C\t loopmax, float lengthW, float angleW, float unusedW, float temperature, float 
;=iemperatureConst , float minEdgeLength, float separationW) 

// start contains the ID of junctions that are preassigned to seedlings. 
// start. size 0 is the number of seedlings assigned initially. 

// Keep track of the path for each seedling, 
std: :vector<std: :vector<int> > paths; 

// Keep track of the length for the paths, 
std: : vector<f loat> pathlength; 

// Keep track of the last "valid" end angle taken for each seedling, 
std: :vector<std: :vector<£loat> > endAngle; 

// Keep track of hypocotyl/ radicle separation 
std : : vector<int> RHseparation; 

std : : vector<int> RHseparat ion2 ; 
std: : vector<f loat> separationlen; 

// Initialize data structures by starting out with a single 

// junction for each seedling 

for(int i=0; i<start j unc . size ( ) ; i++) 

{ 

std : : vector<int> path; 
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paths. push back (path); 

paths [i] . push_back ( start junc [i] ) ; 

std : : vector<f loat> list; 
endAngle .push_back (list) ; 

pathlength . push_back ( 0 . 0£) ; 

RHseparatioii.push_back (-1) ; // Initially^ paths don't have RH separation 
RHseparation2 .push_back (-1) ; 
separationleii.push_back (0 . Of ) ; 


// Keep track of which edge is occupied 

std: :vector<std: :set<int> > edgeOccupation; 
for(i=0; i< j graph- >GetNumEdges 0 ; i++) 

{ 

std: :set<int> edgeset; 
3 edgeOccupation. push_back(edgeset) ; 

} 

// Set initial temperature for annealing, 
float energy = O.Of; 

// Compute the energy of the configuration . 
// Since no edges are occupied by seedlings yet, 
3 // the energy is the sum of penalties for 

f% II unoccupied edges. 

for(i=0; i<jgraph->GetSize 0 ; i++) 

{ 

for(int j=i+l; j <j graph- >GetSize () ; j++) 

{ 

if (j graph- >IsEdge (i , j)) 

energy += unusedW * j graph- >GetEdge (i, j ) ->m_length; 

} 

} 

// add energy for not having hypocotyl/radicle separation, 
energy += separationW * start junc. size () ; 

for(i=0; i<loopmax; i++) 

{ 

// Choose which seedling to update. 

int seedlD = (int) (GETRAND* (double) start junc. size 0 ) ; 

int endjunc = paths [seedID] .back () ; 

bool changeAngle = false; // Whether to change the last "valid" angle or 
not . 

// Extend end or remove end. 

// Choose an edge by throwing a die. 

// Copy all neighboring junctions to neighbors. 

std: :vector<int> neighbors; 

for(int j=0; j <j graph- >GetSize () ; j++) 
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5&GetAngle (choice) ; 
i^e wangle) ; 


{ 

if ( jgraph->IsEdge (endjunc, j ) ) 
neighbors .push__back ( j ) ; 

} 

int choice = neighbors [(int) (GETRAND* (double) neighbors. size ())] ; 

// Try to remove edge if choice is the junction one before the 
// current junction. 

if ( (paths [seedID] . size 0 > 1) (choice == * (paths [seedID] . end () -2) ) ) 

{ 

// Remove edge compute delta energy. 

// * > , ^ . * >* 

// start choice end 

float deltaEnergy; 

float edgeLength = j graph- >GetEdge (choice , endjunc) ->m_length; 

// Removing hypo/rad separation increases energy 

if (RHseparation2 [seedID] == choice) 

{ 

deltaEnergy += separationW; 

} 


// If the edge is sufficiently long, subtract energy for the angle 
if (edgeLength > minEdgeLength) 

{ 

if (enciAngle [seedID] .size 0 > 1) 

{ 

float newangle = j graph- >GetEdge (choice, endjunc) - 


} 


float angle = ComputeAngle (* (endAngle [seediD] .end() -2) , 
deltaEnergy -= angleW * angle * angle; 

} 

changeAngle = true; 


seedID) 


// If the edge is no longer occupied after removal, increase 

// energy. 

if ( (edgeOccupat ion [j graph- >GetEdgeID (choice , endjunc)] .size ()==!) ScSc 

{ *edgeOccupation[j graph- >GetEdgeID (choice, endjunc)] .beginO == 
deltaEnergy += unusedW * edgeLength; 


if ( (deltaEnergy < O.Of) || (exp (-deltaEnergy/ (temperatureConst* 
temperature) ) ) > GETRAND) 

{ 

// Remove the end junction. 
ASSERT (! paths [seedID] . empty ()) ; 

edgeOccupation [j graph- >GetEdgeID (choice , endjunc)] . erase (seedID) ; 
paths [seedID] .pop__back() ; 

if (changeAngle) 

{ 

ASSERT (endAngle . size 0 > 0); 

endAngle [seedID] .pop_back() ; 
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} 

// if the chosen junction was the hypo/rad separation for 
// the seedling, unmark the separation. 

if (RHseparation[seedID] == choice) 

{ 

RHseparation [seedID] = -1; 

} 

if (RHseparation2 [seedID] -= choice) 

{ 

RHseparation2 [seedID] = -1; 

} 


pathlength [seedID] -= edgeLengtli; 
energy += deltaEnergy; 

} 

Q // Add edge if the selected junction is not the end junction itself 

±1 else if ((choice != endjunc) (edgeOccupation [jgraph->GetEdgeID (endjunc, 

Ohoice) ]. find (seedID) == edgeOccupat ion [j graph- >GetEdgeID (endjunc , choice) ]. end ()) ) 

i { 

// Add edge 

g // * > . ^ . * >* 

-3 // start end choice 

ASSERT (j graph- > I sEdge (endjunc , choice)); 

bool newseparation = false; // Whether choice adds a hypo/rad 

fl^eparation or not. 

''f bool separationcomplete = false; 

float deltaEnergy; 

'^"^ float edgeLength = j graph- >GetEdge (endjunc, choice) ->m_length; 

// If the edge is not already occupied, the energy goes down, 
if (edgeOccupat ion [j graph- >GetEdgeID (endjunc , choice) ] . empty () ) 

deltaEnergy -= unusedw * edgeLength; 

int numneighbors = 0 ; 

// See if choice is a separation point by checking for a 
// neighbor edge that is short (and has a degree one at the other 


end??) 


for (int j=0; j < jgraph->GetSize () ; j++) 

{ 

if (jgraph->lsEdge (choice, j)) 
{ 

numne i ghb or s + + ; 

} 

} 

// Mark if this is a new hypo/rad separation, 
if (RHseparation [seedID] == -1) 

{ 

if ( (numneighbors > 2) && (pathlength [seedID] > 20. Of)) 

{ 

newseparation = true; 
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} 

} 

else if ( (RHseparation2 [seedID] == -1) && (pathlength [seedID] - 
separationlen [seedID] > 20. Of)) 

{ 

deltaEnergy -= separationW; 
separationcomplete = true; 

} 

if (edgeLength > minEdgeLength) 

{ 

if ( lendAngle [seedID] .empty 0 ) 

{ 

float newangle = j gr aph - >Ge t Edge (end junc, choice) - 


>GetMgle{end]unc) ; 

newangle) ; 


float angle = ComputeAngle (endAngle [seedID] . front () , 


deltaEnergy += angleW * angle * angle; 
Q // egraph->GetEdge ( jgraph- 

ugGetEdgelD (paths [seedID] [paths [seedID] .sizeO -2] , endjunc) , j graph- >GetEdgeID (end junc , 
i Shoice) ) ; 

J } 

changeAngle = true; 

Ip } 

py if ( (deltaEnergy < O.Of) || (exp ( -deltaEnergy/ (temperatureConst* 

temperature) ) ) > GETRAND) 

a ( 

rn // mark that this seedling has occupied the edge 

edgeOccupation [ j graph- >GetEdge ID (endjunc , 

""shoice) ] . insert (seedID) ; 

ASSERT (edgeOccupation [ j graph- >GetEdgeID (endjunc, choice) ] . size () 

,^^= start j unc . size 0) ; 

paths [seedID] .push_bac]c (choice) ; 

if (changeAngle) 

endAngle [seedID] .push baclc (j graph- >GetEdge (endjunc , 

choice) ->GetAngle (choice) ) ; 

pathlength [seedID] += edgeLength; 

if (newsepar^ti^n) 

{ 

RHseparat ion [seedID] = choice; 
separationlen [seedID] = pathlength [seedID] ; 

} 

if (separationcomplete) 

RHseparat ion2 [seedID] = choice; 

energy +- deltaEnergy; 

} 

} 

// Adjust temperature. 

temperature *= 0.99f; 
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} // simulated annealing loop, 
return paths ; 

} 

float SeedlingAnalyzer : iComputeAngle (float lastAngle, float newAngle) 

{ 

// Compute the angle between lastAngle and newAngle. 

float angle = f abs (newAngle - lastAngle) ; 
if (angle > PI) 

angle = DPI - angle; 

return (PI -angle) ; 

} 
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// File: Image. cpp 

// Author: Yusaku Sako 

II Date: 07/11/99 

#include "stdafx.h" // for Windows 

#include " image. h" 

#include " Image Thi nn i ng. h" // for thinning a binary image 
#include " Connect ivityGraph .h" 
# inc lude " Con s t . h " 
#include <math.h> 

#ifndef ROUND 

#define ROUND (x) ( (int) (x+0.5)) 
#endif 


Eximage* Eximage :: Crop ( int Ix, int ly, int rx, int ry) 

{ 

Image* dupimage = duplicate_Image (m_image) ; 
Q Image* newimage = :: crop (dupimage, ly, Ix, ry-ly+1, rx-lx+1) ; 

Eximage* returnimage = new Eximage; 
returnimage- >m_image = newimage; 

return returnimage ; 

5 

i'ii 

:,ExImage* Eximage :: Trans formToHSV (int numlevels) 
ff^^ Eximage* newimg = (Eximage*) Get Copy () ; 

float norm [3] ; 

norm[0] = numlevels; norm[l] = numlevels; norm [2] = numlevels; 
^2 newimg- >m_image = colorxform (newimg- >m_image, HSV, norm, NULL, 1); 

return newimg; 

} 

Bxlmage* Eximage: : Get 2DHistograin( int xcolor, int ycolor, int size) 

{ 

Eximage* histlmg = new Eximage; 

histlmg~>m_image = new_Image ( PGM , GRAY__SCALE, 1, size, 
size, CVIP_BYTE, REAL); 

const int HIGH = 2 55; 

const int BIAS = 128; 

unsigned char ** xpix = (unsigned char**) m_image->image__ptr [xcolor] - >rptr ; 

unsigned char ** ypix = (unsigned char**) m_image->image_ptr [ycolor] ->rptr ; 

unsigned char ** hpix = (unsigned char**) histlmg->m_image->image_j)tr [0] ->rptr ; 

int kx, ky, lix, hy, max, kk; 

// Clear image, 

for (int i=0; i<size; i++) 

for(int j=0; j<si2e; j++) 

{ 

hpix[i] [j] = (unsigned char)Of 
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} 

max = 0 ; 
kx = 1; 
ky - 1; 

for(i=0; i<si2e; i++) 

{ 

for(int j=0; j<size; 

{ 

hy = {HIGH - ypix[i] [j])/ky; 
hx = (xpix[i] [j])/kx; 
if (hpix[hy] [hx] < HIGH) 

hpix[hy] []ix]++; 

if (max < hpix [hy] [lix] ) 

max = hpix [hy] [hx] ; 

} 

for(i=0; i<gize; i++) 
{ 

for(int j=0; j<size; j++) 

^1 { 

Ln if (hpix [i] [j] !=0) 

U kk = hpix[i] [ j ] *HIGH/max+BIAS ; 

if (kk > HIGH) 

:-i hpix[i] [j] = (unsigned char) HIGH; 

fU else 

hpix[i] [j] = (unsigned char)kk; 

ib ) 
□ J 

return histlmg; 
''Eximage* Eximage :: Threshold (unsigned char thresh) 

{ 

Eximage *returnlmage = new Eximage; 

returnlmage->m_image - threshold_segment (m_image , thresh, CVIP_NO) ; 

/* 

<inputlmage> - pointer to Image structure 
<threshval> - threshold value 
< t hre sh_inby t e > 

- CVIP_NO apply threshval directly to image data; 

- CVIP YES threshval is CVIP BYTE range; remap to image 

data range before thresholding, 

*/ 

return returnlmage; 

} 

Eximage* Eximage :: Threshold (int rlow, int rhigh, int glow, int ghigh, int blow^ int 
bhigh) 

{ 

Eximage* threshlmg = new Eximage; 

threshlmg->m_image = new_Image ( PGM , GRAY_SCALE, 1, getNoOfRows_Image (m_image) , 
getNoOf Col s_Image (m_i mage) , CVIP_BYTE, REAL); 
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unsigned char** origR = (unsigned char**) m_image->imagejptr [0] - >rptr ; 
unsigned char** origG = (unsigned char**) m_image->image_ptr [1] - >rptr ; 
unsigned char** origB - (unsigned char**) m_image->image_ptr [2 ] - >rptr ; 

unsigned char** dest = (unsigned char**) threshlmg->m_image->image_ptr [0] ->rptr ; 

for(int y=0; y<getNoOfRows_Image (m__image) ; y++) 

£or(int x=0; x<getNoOfCols_Image(m__image) ; x+4-) 

{ 

bool flag = true; 

if (origR[y] [x] < rlow | | origR [y] [x] > rhigh) 
flag = false/ 

if (origG[y] [x] < glow | | origG [y] [x] > ghigh) 

flag = false; 
if (origB [y] [x] < blow | | origB [y] [x] > bhigh) 

flag = false; 

if (flag) 

dest [y] [x] = 255; 

else 

'}Z dest [y] [x] ^ 0; 

i } 

return threshlmg; 

il 

• iximage* Eximage : : Threshold (ThreshParams thresh) 

^ 

^™ return Threshold (thresh. rrain, thresh. rmax, thresh. gmin, thresh. gmax, thresh. bmin, 

^"ghiresh . bmax) ; 

3 

Perform Thresholding segmentation based on histogram 
='BxImage* Eximage: iHistogramThreshold () 

{ 

Eximage *returnlmage = new Eximage; 
returnlmage->m_image = hist_thresh_gray (m_image) ; 

return returnlmage; 

} 

Eximage* Eximage: :HistogramEqualization () 

{ 

Eximage * returnlmage - new Eximage; 

Image* temp; 

temp = histeq (m_image, 0); 
//temp = histeq(temp, 1); 
//temp = histeq(temp, 2); 
returnlmage ->m_image = temp; 

returnlmage -sm_imagG = remap_Image (temp, CVIP_BYTE, 0, 2S5); 

return returnlmage; 

} 

Eximage* Eximage :: EdgeDe tec t (int type) 

{ 
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Eximage ^returnlmage = new Eximage; 

returnlTnage->Tn_iTnage = edge_detect_setup {Tn_iTnage, 1); 
return returnlmage; 

} 

// Peirform skeletonization on the image. 
Eximage* Eximage :: Thin ( ) 

{ 

Eximage *returnlmage = new Eximage; 

returnlmage ->m_image = : : ImageThinning {m_image) ; 

return returnlmage; 

} 

Eximage* Eximage :: Mo rphOp en ( int kerneltype, int kernelsize, 
int kernelheight, int kernelwidth) 

{ 

Eximage *returnlmage = new Eximage,* 

iretur-nTmage- >Tn image = : : Mor-phOpen (m_image , kemeltype , kerneLs ize , kernelheight, 

kernelwidth) ; 

r3 // DEBUG 

'■:n est ring msg; 

IJl msg. Format ("Image params: width=:%d height=%d bandg=%d colorspace=%d" , returnlmage- 

;.^m_image- >image_ptr [0] ->cols, returnlmage ->m_i mage - >image__ptr [0] ->rows , returnlmage- 

i^>m_image->bands , returnlmage ->m_image->color_space) ; 
V //AfxMessageBox (msg) ; 

return returnlmage; 

s 

^^Exlmage* Eximage : rMorphC lose (int kerneltype, int kernelsize, 
int kernelheight, int kernelwidth) 

a 

Eximage *returnlmage = new Eximage; 

returnlmage ->m_image = : :MorphClose (m_image, kerneltype, kernelsize, kernelheight, 
'^Mernelwidth) ; 
Q return returnlmage; 

} 

Eximage* Eximage :: Mo rphDilate (int kerneltype, int kernelsize, 
int kernelheight, int kernelwidth) 

{ 

Eximage *returnlmage = new Eximage; 

returnlmage ->m_image = : :MorphDilate (m_image, kerneltype, kernelsize, kernelheight, 

kernelwidth) ; 

return returnlmage; 

} 

Eximage* Eximage :: MorphErode ( int kerneltype, int kernelsize, 
int kernelheight, int kernelwidth) 

{ 

Eximage *returnlmage = new Eximage; 

returnlmage ->m_image = :: MorphErode (m_image, kerneltype, kernelsize, kernelheight, 
kernelwidth) ; 

return returnlmage; 

} 

yy Convert a color image to gray scale based on luminance. 
Eximage* Eximage :: ConvertToGrayscale (int maxvalue) 
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{ 

Eximage *returnlmage = new Eximage; 

returnlmage->m_image = :: CVIP luminance (m_iTnage, maxvalue, 
CVIP_YE2. CVIP_MO); 

return returnlmage ; 

} 

// Perform median filter on the image. 

Eximage* Eximage :: MedianFi Iter ( int kernelsize) 

{ 

Eximage *returnlmage = new Eximage; 

returnlmage ->m_image = : :median_f ilter (m_image, kernelsize) ; 
return returnlmage; 

} 

Eximage* Eximage :: CutOut (int Ix, int ly, int rx, int ry) 
{ 

ASSERT (lx>=0) ; 
ASSERT (ly>=0) ; 

^3 ASSERT (rx<getNoOf Cols_Image (m_image) ) ; 

;Q ASSERT (ry<getNoOf Rows_Image (m_image) ) ; 

0 Image* dupimg = duplicate_Image (m__image) ; 

unsigned char** pix = (unsigned char**)dupimg->image_ptr [0] -?>rptr/ 

for (int y=ly; y<=ry; y++) 

=0 { 

for (int x=lx; x<=rx; x++) 

{ 

pix[y] [x] = OU; 

1 } 

=J Eximage *returnlmage = new Eximage; 

returnlmage ->m_image = dupimg; 
return returnlmage; 

} 

Eximage* Eximage :: Minus (Eximage* inimage, int Ix, int ly, int rx, int ry) 

{ 

Image* diffimg = duplicate_Image (m_image) ; 

unsigned char** pixl = (unsigned char**) diffimg- >image_ptr [0] ->rptr; 

unsigned char** pix2 = (unsigned char**) inimage- >m_image->imag e_ptr [0] ->rptr; 
for (int y=ly; y<=ry; y++) 

{ 

for (int x=lx; x<=rx; x++) 

{ 

int dif f = pixl [y] [x] - pix2 [y-ly] [x-lx] ; 
diff = (diff<0) ? 0 : diff; 
pixlly] [x] = diff; 

} 

} 

Eximage* returnlmage = new Eximage/ 
returnlmage ->m_image - diffimg; 
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return returnlmage; 

} 

Eximage* Eximage: : Blend (Eximage* inimage, float weight_orig, float weiglit_in, bool 

iiivert_orig, bool invert_in) 

{ 

// Image sizes must match. 

ASSERT CgetNoOf Col s_Image (m_image) == getNoOf Col s_Image (inimage- >m__image) ) ; 
ASSERT ( get NoOf Rows Image (m image) == getNoOfRows Image (inimage ->m image)); 
ASSERT (( weigh t_orig >= 0.0) ( weight_orig <= 1.0)); 

Image* newimage = new_Image (PPM, RGB, 3, getNoOfRows_Image (m_image) , 
getNoOfCols_Image (m_image) ,CVIP_BYTE, REAL) ; 


int numbands = getNoOfBands_Image (inimage- >m_image) ; 

char **srclR = m_image- >image_ptr [0 ] - >rptr ; 

char **src2R - inimage->m_image->image _ptr [0] - >rptr ; 

unsigned char **destR = (unsigned char**) newimage- >imagejitr [0] ->rptr; 

char **BrclG = m_image-^imagGjptr [1] ->rptr; 

char **src2G = (numbands>l) ? inimage- >m_image- >image_ptr [1] - >rpt:r : inimage- 
'fem_image- >image_ptr [0] ->rptr; 

"L:;:; unsigned char **destG = (unsigned char**) newimage ~>image_ptr [1] ->rptr; 

"T" char **srclB = m_image- >image j>tr [2 ] ->rptr; 

'Z char **src2B = (numbands >2) ? inimage ->m_image->iTnage_ptr [2] ->rptr : inimage- 

''^m_image- >image j)tr [0] ->rptr; 

unsigned char **destB = (unsigned char**) newimage- >imagejitr [2] ->rptr; 

unsigned char srclr, src2r, srclg, src2g, srclb, src2b; 
£or(int v=0; y<igGtMoO£Rows_Image (m_imag6) ; y++) 

for (int x=Q; x<getNoOf Cols_Image (m_image) ; x++) 

::J if (invert_orig) 

srclr = -srclR[y] [x] -1; 
srclg = -srclGEy] [x] -1; 
srclb = -srclB[y] [x]-l; 

} 

else 

{ 

srclr = srclR[y] [x] ; 
srclg = srclG[y] [x] ; 
srclb = srclB [y] [x] ; 

} 

if (invert_in) 

( 

src2r = -src2R[y] [x] -1 
src2g = -src2G[y] [x] -1 
src2b = -src2B[y] [x] -1 

} 

else 

{ 

src2r = src2R [y] [x] / 

src2g = src2G [y] [x] ; 
src2b = src2B [y] [x] ; 
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destR [y] [x] 

char) ( (weight_orig* (float) (srclr) +weight_in* (float) src2r) /2) ; 
destG[y] [x] 

char) ( (weight__orig* (float) (srclg) +weight_in* (float) src2g) /2) ; 
destB[y] [x] 

char) ((weight orig* (float) ( srclb) +weight_in* (float) src2b) /2) ; 
} 

Eximage *ret = new Eximage; 
ret->m_iTnage = newimage; 
return ret; 

} 

Eximage* Eximage :: Mask (Eximage* maskimage, ColorType bgcolor) 

{ 

Eximage * outimage = (Eximage* ) Get Copy () ; 

unsigned char** mpix = inaskiTnage->GetPixelArray(0) ; 

unsigned char** srcR = GetPixelArray ( 0 ) ; 
unsigned char** srcG = GetPixelArray (1) ; 
unsigned char** srcB = GetPixelArray (2) ; 

IJl unsigned char** dstR = outimage->GetPixelArray (0) / 

unsigned char** dstG = outimage- >GetPixelAr ray (1) ; 

hi unsigned char** dstB = outimage- >GetPixelArray (2) ; 

rM for(int y=0; y<maskimage - >GetHeight ( ) ; y++) 

r { 

for{int x=0; x<Tnaskimage->GetWidth () ; x++) 

m { 

if (mpix [y] [x] > 0) 

{ 

,q dstR [y] [x] = srcR [y] [x] ; 

I? dstG [y] [x] = srcG [y] [x] ; 

dstB [y] [x] = srcB [y] [x] ; 

} 

else 

{ 

dstR [y] [x] = bgcolor. r; 
dstG [y] [x] = bgcolor. g; 
dstB [y] [x] = bgcolor. b; 

} 

} 

} 

return outimage; 

} 

ObjectList label_0bjects2 (Image *imageP, Image **labelP, unsigned background); 
// Return objects found in the image. 

BinaryObjects* Eximage: :GetObjects() 

{ 

Image* labellmage; 
ObjectList objlist; 

objlist = label_0bjects2 (m_image, &:labellmage, 0); 


(unsigned 

(unsigned 
(unsigned 
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// Make sure objlist is not NULL 
if { I obj list) 

objlist = new_LL(); 

BinaryObjects *binob]s = new BinaryObjects (objlist, labellmage) ; 

return binob j s ; 

} 

int Eximage: :FindPeakValue (int band) 

{ 

II Find peak. 

unsigned char **pix = (unsigned char**)m_iTnage->image_ptr [band] ->rptr; 
long* histogram = new long [256]; 

for(int i=0; i<255; i4-+) 

histogram [i] - 0; 
for (int y=0; y<GetHeight ( ) ; y++) 

{ 

for (int x=0; x<GetWidth ( ) ; xtt) 

a { 

histogram [pix [y] [x] ] ++; 

} ^ 

// Find tlie peak. 
= .3 int high = 0; 

for (1=0; i<25S; 

L"" { 

f% if (histogram [i] > histogram [high] ) 

^'S high = i; 


;f delete [] histogram; 

— ' return (high) ; 

} 

ColorType Eximage; :GetAverageColor () 

{ 

long rsum - 0 , gsum - 0 , bsum = 0 ; 

unsigned char** pixR = (unsigned char**) m_image->image_ptr [0] ->rptr ; 
unsigned char** pixG = (unsigned char**) m_image->image j>tr [1] - >rptr ; 
unsigned char** pixB = (unsigned char**) m_image->image_ptr [2] ->rptr ; 

for (int y=0; y<getNoOf Rows_Image (m_image) ; y++} 

for (int x=0; x<getNoOf Cols_Image (m_image) ; x++) 

{ 

rsum += pixR [y] [x] ; 
gsum += pixG [y] [x] ; 
bsum pixB [y] [x] ; 

} 

ColorType color; 

color. r = rsum/ (getNoOf Rows_Image (m_image) *getNoOf Cols_Image (m_image) ) ; 
color. g = gsum/ (getNoOf Rows_Image (m_image) *getNoOf Cols_Image (m_image) ) ; 
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} 


color, b = bsum/ (getNoOf Rows__Image {m_image) *ge1::NoOf Cols_lTnage {m_image) ) / 
return color; 


// Dump properties of all objects, 
void BinaryOb j ects : : Dump ( ) 

{ 

]ieacl_LL{m_obiectlist) ; // set linked list pointer to the head 

for(int i=0; i<size_LL (m_objectlist) ; i++) 
{ 

Object *obj = ({Object *) retrieve_LL (m_objectlist ) ) ; 
CString msg; 

msg. Format ("label=%d; R=%d G=%d B=%d; xmin^^d ymin=%d xmax=%d ymax=%d;\ 

eigenratio=%f ; orientation=%f ; horizontal cog=%f vertical cog=%f; area=%f", 

obj->label, obj ->pixel . r, obj ->pixel .g, obj ->pixel .b, obj->x_min^ obj 
>y_min, obj->x_max, obj->y_max, obj - >prop . eig__ratio , obj ->prop . orientation, obj 
>prop.h_cog, obj ->prop.v_cog, obj ->prop. area) ; 

AfxMessageBox (msg) ; 
next LL (m objectlist) ; 

.0 } - - 

■..int _cdecl Matchint (void* content, void* lookforP) 
ry return (*( (int*) content) == *( (int*) lookforP) ) ; 

ffl/ Remove objects whose sizes are equal to or less than minarea . 
p^oid BinaryObj ects :: FilterOut (int minarea) 

P\ if (m_objectlist->listlength == 0) 
^ return; 

getProp_Obj ects (m_object list; m_labellmage) ; 

head_LIj (m_objectlist) ; 
previous_LL (m_obj ectlist ) ; 

//int** pix = (int**) m_label Image- >image_jptr [0] - >rptr; 

for(;;) 
{ 

Object* obj = ((Object *) retrieveNext_LL (m_obj ectlist) ) ; 
if (obj - >prop . area < minarea) 

{ 

// Erase pixels belonging to this object from the label image 
for (int y=obj ->y_min; y<=obj ->y_max; y++) 

for (int x=obj ->x_min; x<=obj ->x_max; x++) 

{ _ _ 

if ( ( (int*)m_labellmage-5.image_ptr [0] ->rptr [y] ) [x] == obj 

>label) 

{ 

( (int*) m_labellmage->image_ptr [0] ->rptr [y] ) [x] = 0; 
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} 

} 


removenext_LL (m_objectlist) ; 

} 

else 

next_LL (m_objectlist) ; 
if (istail_LL (m_objectlist) ) 

break; 

} 

} 

Eximage* BinaryOb j ects : ; CreateContourlmage ( ) 

{ 

Image* returnimg; 

returnimg ~ new_Image ( PBM ^ BINARY, 1, getNoOf Rows_Image (m_label Image ) , 
getNoOf Cols^Image (m_labellmage) , CVIP_BYTE, REAL) ; 

/* 

returnimg = new_Image (TIP, BINARY, 

"J 1, getNoOf Rows_Image (m_label Image ) , getNoOf Cols_Image {m_labellmage) , 

CVIP_BYTE, REAL) ; 
* / 

^"l II Extract chain code from each object, and draw them onto returnimg. 

:'r^ // dump labelled image 
CString msg; 

:^ /* 

msg. Format ("# bands=%d width=%d height=%d format=%d type=%d, space=%d" , 
:,fii_l abe 1 Image - >bands , 

Q getNoOf Col s__Image (m_l abe 1 Image) , getNoOf Rows_Image (m_label Image) , 

;.m__l abe 1 Image - > image_f ormat , 

Q m_labellmage->image_ptr [0] ->data_type, m_labelImage->color_space) ; 

Q AfxMessageBox (msg) ; 

msg. Format ( "# bands=%d width=%d height=%d format=%d tYpe=%d, space=%d", returnimg- 
>bands, 

getNoOf Col s__Image (returnimg) , getNoOf Rows_Image (returnimg) , returnimg- 

:>image_£ormat, 

returnimg- >image_ptr [0] ->data_type, returnimg- >color_space) ; 
AfxMessageBox (msg) ; 
*/ 

head_LL (m_objectlist) ; 

for ( ; ; ) 
{ 

int ray_x; 

Object *obj = ( (Obj ect*) ret2rieve_LL (m_objectlist) ) ; 

//shootRay (m_labellmage, obj->label, &:ray_x, &:ray_y, obj->x_min, obj->y_min, 
obj - >x_max, obj - >y_max) ; 

for (int c=obj ->x_min; c<=obj ->x_max; C++) 

{ 

if ( ( (int*)m_labellmage->image_jptr [0] ->rptr [obj->y_min] ) [c] == ob j - 

>label) 

{ 
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raY_x = c; 
break; 

} 

} 

ChainCode* cc = new_ChainCode (obj ->y_min, ray_x^ obj->label); 

if (build_LineChainCode (cc, m_label Image, obj->x_min, obJ->y_min, obj->x_max, obj- 
>y_max) ==0) 

Af xMessageBox ( "Error building chain code I") ; 
draw__ChainCode (cc, returnimg) ; 

if (istail_LL(m_objectlist) ) 

break; 
next_LL (m_objectlist) ; 

} 

Eximage* newimg = new Eximage; 
newimg->m_image = returnimg; 

return newimg; 

} 

'Iximage* BinaryOb j ects : : Createlmage ( ) 
Image* returnimg; 

""^ returnimg = new_I mage (PGM, GRAY_SCALE, 1, getNoOf Rows_Image (m_labellmage) , 

getNoOfCols_Image (m_labellmage) , CVIP_BYTE, REAL) ; 

for{int y=0; y<getNoOf Rows_Image (m_labellmage) ; y++) 

£or(int x=0; x<getMoO£Cols_Image (m_label Image ) ; x++) 

{ 

if ( ( (int*)m_labellmage->imagejitr [0] ->rptr [y] ) [x] > 0) 
returnimg- >imagej)tr [0] - >rptr [y] [x] = 255U; 

else 

returnimg- >image_ptr [0] - >rptr [y] [x] = 0; 

} 

Eximage* newimg = new Eximage; 
newimg- >m_image = returnimg; 

return newimg; 


=^3 


} 


Connect ivityGraph<Edge *>* BinaryObj ects :: Create JunctionGraph (Obj ect Info* objinfo, 
std: :vector< Junction* >& junclist /* output */) 

{ 

// Find all junctions. 

junclist = Compute June t ions (obj info) ; 

TRACE("There are %d pre- j unctions\n" , junclist - size ()) ; 

ConnectivityGraph<Edge *>* eg = new ConnectivityGraph<Edge *> (false, 
junclist . size ( ) ) ; 

//int *degreelist = new int [junclist. sized]; 

// Copy degrees. 

//for (int i=0; j unclist . size () ; i++) 

//{ 
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// degreelist [i] = junclist [i 3 - >degree ; 
//} 

// Connect nodes. 

for(int i = 0; i< junclist - size () ; i + +) 

{ 

int c = 0 ; 
float oldlen; 

while (junclist [i] ->Tn__neighborPixels . size () != 0) 

{ 

Edge *edge ~ new Edge; 

TRACE ("j [%d] 's next neighbor is %d\n\ i, * (junclist [i] - 

>m__neighborPixels . begin () ) ) ; 

int nextjunc = FindNext Junction (junclist , * (junclist [i] - 

>ni_neighborPixels.begin()) , i, *edge); 

// If nextjunc is i itself, then this is a terminal loop. 
// Simply ignore it. 
if (nextjunc 1= i) 

{ 

□ TRACE ("Inserting edge (%d, %d)\n", i, nextjunc); 


,gdge . 


// If there is already an edge (i, nextjunc) , ignore the new 

if ( 1 cg->IsEdge (i , nextjunc)) 

,a oldlen = edge->m_length; 

^^hI cg->InsertEdge (i , nextjunc, edge); 

^ else if (edge->Tn_length < oldlen) 

; ( 

cg->DeleteEdge (i , nextjunc); 
cg->InsertEdge (i, nextjunc, edge); 

} 

3 II Erase the neighbor that leads to nextjunc and 

// erase the neighbor that leads to i so as to avoid 
// duplicate processing of the same edge, 

TRACE ("Erasing neighbor %d from j [%d] and %d from j[%d]\n", edge- 

>GetNeighbor (i) , i, edge- >GetNeighbor (nextjunc) , nextjunc); 

junclist [i] ->m_neighborPixels . erase (edge- >GetNeighbor (i) ) ; 
junclist [nextjunc] - >m_neighborPixels . erase (edge- 

>GetNeighbor (next junc) ) ; 

//degreelist [i] --; 
C++; 

} 

else 

{ 


neighbor 


// Erase the neighbor pixel that leads to the loop 

// In case of loop, edge- >GetNeighbor ( 0 ) returns the first 

// and edge- >GetNeighbor (1) returns the last neighbor 
junclist [i] ->m_neighborPixels .erase (edge->GetNeighbor (0) ) ; 
junclist [i] ->m_neighborPixels . erase (edge- >GetNeighbor (1) ) ; 
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TRACE ("There are %d post edges\n" , cg->GetNumEdges ( ) ) ; 
return eg; 

} 

int BinaryObj acts :: FindNext Junction (std : :vector< Junction *> junclist, int neighbor, int 

Start, EdgeSc edge) 

{ 

// FOR DEBUG 

PILE* out = £open( "junction.txt", "w") ; 

int** pix = (int**) m_label Image -> image J) tr [0] ->rptr ; 

int deg; 

int X = junclist [start] ->m_x; 
int y = junclist [start] ->Tn_y; 

edge. m_j unci = start; 


/ / Keep traclc of all coordinates . 
edge . m_xarray . clear 0 ; 
edge .m_y array . clear 0 ; 

edge . Tn_xarray . push_back (x) ; 
edge.m_yarray.pus]i_back(y) ; 

edge.m_xmin = 1000000; 
edge . m_xmax = - 1 ; 
edge.m_ymin = 1000000; 
edge . m_ymax = - 1 ; 

// FOR DEBUG 

fprintf(out, "finding the next junction for junction %d\n", start); 

do 

{ 

fprintf(out, "neighbor=%d\n" , neighbor); 
switch (neighbor) 

{ 

case 0 : 

X = x+1; 

y = y; 

edge.m_length += l.Of; 

break; 
case 1: 

X = x+1; 

y = y+1; 

edge.m_length += l,41421356f; 
break; 
case 2 ; 

X = x; 

y = y+i; 

edge .m_length l.Of; 
break; 
case 3 : 

X = X-1; 
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y = y+i; 

edge.m_length t= l,4142l356ff 

break ; 
case 4 : 

X = x-1; 

y = y; 

edge .m_length += l.Of; 
breaks- 
case 5 : 

X = x-1; 

y = y-i; 

edge.m_length += 1.41421356f; 
break; 
case 6 : 

X = x; 

y - y-i; 

edge.m_length +- l.Of; 

break; 
case 7 : 

X = x+1; 

y = y-1; 

eclge.m_lengtk += 1.4142135S£; 
break; 

} 



if (x 

< edge .m_xmin) 




edge . m__xmin = 

x; 


if (X 

> edge.m_xTnax) 




edge . m_xmax = 

x; 


if (y 

< edge .Tn_ymin) 




edge , m_ymin = 

y; 


if (y 

> edge .m_ymax) 




edge.m_ymax = 

y; 


Q edge . m_xarray . push_back (x) ; 

edge . m_y array . push_back (y ) ; 

// Is the current position a junction? 

// neighbor 
// 5 6 7 

II 4 0 
// 3 2 1 

int nextNeighbor ; 
deg=0; 

if ( (pix[y] [x+1] 1= 0) &&(neighbor 1= 4)) 

{ 

deg-f + ; 

nextNeighbor = 0; 

} 

if ( (pix[y+l] [x] != 0) && (neighbor != 6)) 

{ 

deg++; 

nextNeighbor = 2; 
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if ((pix[y] [x-1] != 0 )&& (neighbor 1= 0)) 
deg++; 

nextNeighbor = 4; 
if ( (pix [y-l] [x] i= 0) && (neighbor 1= 2)) 
deg++; 

nextNeighbor = 6; 

if ( (pix[y+l] [x+l] 1= 0) && (pix [y] [x+1] ==0) && (pix [y+1] [x] ==0) && (neighbor 1= 5)) 
deg++; 

nextNeighbor = 1/ 

if ( {pix[y+l] [x-1] i= 0) && (pix [y+1] [x]==0)&5c (pix [y] [x-1] ==0)&& (neighbor 1= 7)) 
deg++; 

nextNeighbor = 3 ; 

if ( (pix [y-l] [x-1] 0) && (pix [y-l] [x]==0)&:& (pix [y] [x-1] = = 0)&& (neighbor != 1) ) 

deg++; 

nextNeighbor = 5; 

if ( (pix [y-l] [x+l] != 0) &£c (pix [y-l] [x] ==0) (pix [y] [x+l] ==0) £c& (neighbor 1= 3)) 

deg++; 

nextNeighbor = 7; 

} 

fprintf(out, "degree=%d nextneighbor=%d\n" , deg, nextNeighbor); 
neighbor = nextNeighbor; 
} while (deg == 1); 

// Compute the angle the edge forms at each junction (with respect to x-axis) . 

// 1. angle at junction 1 

int chainlen = edge .m_xarray. size () ; 

int dx = edge.m_xarray [min(4, chainlen-1) ] - edge . m_xarray [ 0 ] ; 

int dy = edge .m_yarray [min (4 , chainlen-1)] - edge . m_yarray [ 0 ] ; 

if (dx == 0) 
{ 

if (dy < 0) 

edge .Tn_anglel = HPI; 

else 

edge .Tn_anglel = -HPI; 

} 

else 

edge .Tn_anglel - atan2 { (double) -dy, (double) dx) ; 
dx = edge. m_xarray [max (chainlen-5, 0)] - edge .m_xar ray [chainlen-1] ; 

dy = edge. m_yarray [max (chainlen-5, 0)] - edge.m_yarray [chainlen-1] ; 

if (dx == 0) 
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{ 

if (dy < 0) 

edge .m_angle2 = HPI; 

else 

edge . m_angle2 = -HPI ; 

} 

else 

edge.m_angle2 = atan2 ( (double) -dy, (double) dx) ; 

// Return the ID of the junction 
for(int i=0; i< junclist . size () ; i++) 

( 

if ( (junclist [i] ->m_x == x) (junclist [i] ->m_y == y) ) 

{ 

edge .m_junc2 = i; 

f close (out) ; 
return i; 

} 

} 

£or(i=0; i< junclist . size () ; i++) 

{ 

fprintf(out, "junc %d-%d %d\n" , i, junclist [i] - >m_x, junclist [i] ->m_y) ; 

} 

f close (out) ; 

ASSERT (FALSE) ; 

return -1; // Error! 1 ! 


■^gonnectivityGraph<f loat >* BinaryObj acts : : CreateEdgeGraph (ConnectivityGraph<Edge *>* jg 
:fejectInfo* objinfo) 

'^f // Edge Graph 

3 ConnectivityGraph<f loat>* eg = new ConnectivityGraplxf loat> (false; jg 

jGetNumEdges () ) ; 

//CString msg; 

//msg. Format ( "junction graph: number of edges=%d"^ jg->GetNumEdges () ) ; 

//AfxMessageBox(msg) ; 

// For each edge-to-edge connection, compute the angle between the edges, 
int JGsize = jg- >GetSize ( ) ; 
for(int 1=0/ i<JGsize; i++) 

{ 

for (int j=i+l; j<JGsize; j++) 

{ 

if ( jg->IsEdge (i, j)) 

{ 

for (int k=0; k<JGsize; k++) 

{ 

if ( jg->IsEdge ( j , k) && (i != k)) 

{ 

// Compute the angle between i,j,k 
// i 
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// 

// / \ 

// / \ 

// / \ 

// j k 

if (!eg->IsBdge(]g->GetBdgelD(i, j) , ig->GetBdgeiD(] 


k) ) ) 


{ 


j g- >GetEdge { j , k) - >GetAnglG ( j ) ; 


float angle = jg->GetEdge (i , j )- >Get Angle (j ) 
if (angle < O.Of) 

angle += DPI; 
if (angle > PI) 

angle = DPI - angle; 
eg->InsertEdge ( jg->GetEdgeID (i; j) , jg 


>GetEdgeID ( j , k) , angle) ; 


//est ring msg; 

//msg. Format ( "Inserting edge %d %d for %d % 
r^". jg->GetEdgeID(i, j) , jg->GetEdgeID ( j , k) , i, j, k) ; 
= g / /Af xMessageBox (msg) ; 

m } 

Jn } 
. else if (jg->IsEdge (i, k) && (j != k)) 

^: { 

// Compute the angle between i,j,k 

// j 
// 

// / \ 
// / \ 
// / \ 

// i k 

if ( !eg->IsEdge(jg->GetEdgeID(i, j), jg->GetEdgeID (i 


k)) ) 


jg->GetEdge (i,k) ->Get Angle (i) 


{ 


float angle = jg->GetEdge (i, j ) ->GetAngle (i) 

if (angle < O.Of) 

angle += DPI; 
if (angle > PI) 

angle = DPI - angle; 
eg->lnsertEdge ( jg->GetEdgeID (i , j), jg 


>GetEdgeID (i, k) , angle) ; 


est ring msg; 

msg. Format ("Inserting edge %d %d for %d %d %d" 

jg->GetEdgeID (i, j ) , jg->GetEdgeID (i, k) , i^ j, k) ; 

AfxMessageBox (msg) ; 

} 

} 


return eg; 
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) 

Eximage* BinaryObjects : : Great e Junctionlmage (std: :vector<0bjectlnfo*> objinfo) 

{ 

Image* jtreturaimg; 

returnimg = new_Image (PPM, RGB, 3, getNoOfRows_lTnage (m_label Image ) , 
getNoOf Cols_Image (m_labellmage) , CVIP_ByTE, REAL) ; 

head_LL {m_objectlist ) ; 

int** srcpix = (int**) m_labellmage- >image__ptr [0] ->rptr ; 

unsigned char** destpixR = (unsigned char**) returnimg -> image j>tr [0] ->rptr; 
unsigned char** destpixG = (unsigned char**) returnimg ->image_ptr [1] ->rptr; 
unsigned char** destpixB = (unsigned char**) returnimg ->image_ptr [2 ] ->rptr; 

for(int i=0; i<size_LL(m_objectlist) ; i++) 

{ 

object* obj = (Object*) retrieve_LL (m_objectlist) ; 
for (int y = obj->y_Tnin; y <= obj->y_max; y++) 

ri { 

for (int X = obj->x_min; x <- obj->x_max; x++) 

S { 

'"^ if (srcpix [y] [x] == obj->label) 

S ( 

>™ destpixR [y] [x] = 2 55; 

/JT destpixG [y] [x] = 255; 

destpixB [y] [x] = 255; 

ry } 

L } 

} 

linked_list* jlist = obj info [i] - >j unctions ; 
head_LL ( j list) ; 

for(int j=0; j <size_LL ( j list) ; j++) 
{ 

Junction* junc = ( Junction*) retrieve_LL (j list) ; 
for (int k=0; k< junc->m_degree; k++) 

{ 

int jx = junc->m_x, jy = junc->m_y; 

switch ( j unc - ?>m_degree ) 

{ 

case 3 : 


case 6 


destpixR [ jy] 

[jx] 


2 55; 

destpixG [jy] 

[jx] 


0; 

destpixB [jy] 

[jx] 


0; 

break; 




destpixR [ jy] 

[jx] 


255; 

destpixG [ jy] 

[jx] 


255; 

destpixB [jy] 

[jx] 


0; 

break; 




destpixR [ jy] 

[jx] 


0; 

destpixG [ jy] 

[jx] 


255; 

destpixB [jy] 

[jx] 


0; 

break; 




destpixR [jy] 

[]X] 


0; 
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cle5tpixG[jy] [jx] 

destpixB [jy] [jx] 

break; 
case 7 : 

destpixR[jy] [jx] 
destpixG[jy] [jx] 

destpixB [jy] [jx] 

break; 

} 

} 

next_LL{jlist) ; 

} 

next_LL (m_objectlist ) ; 

} 

Exlmage *newimg = new Eximage; 
newimg->m_image = returnimg; 

re turn newimg ; 


^iSoid OlDjectlnfo: :Duinp() 

CString msg; 

Uj msg. Format ( "xmin=%d xmax=%d ymin=%d ymax=%d\nperimeter=:%d area=%d eigenratio=%f 

fgrientation=%f \nxcenter=%f ycenter=%f numjunc=%d", 

xmin, xmax, ymin, ymax, perimeter, area, eigenratio, orientation, xcenter, 
f^center, numjunc) ; 

AfxiyiessageBox(msg) ; 

:itcl: :vector<0]3jectlnfo*> BinaryOlDjects: ;GetOb]ectInfo(]DOOl iaulldCliaincode) 

std: : vector<0bjectlnfo*> infolist; 
if (m_objectlist->listlength == 0) 

return infolist; 

getProp_Obj ects (m_obj ectlist , m_labellmage) ; 
head__LL (m_obj ectlist) ; 

for(int i=0; i<size_LL (m_obj ectlist) ; i4-+) 

{ 

int ray_x ; 

Object* obj = ( (Object*) retrievG_LL(m_objectlist) ) ; 

//shootRay (m_label Image, obj->label, &:ray_x, &:ray_y, obj->x_min, obj->y_min, 
obj - >x_max , obj - >y_max) ; 

for (int c=obj ->x_min; c<=obj ->x_max; C++) 

{ . , 

if ( ( (int*) m__labellmage->image jtr [0] ->rptr [obj ->y_min] ) [c] == ob j - 

>label) 

{ 

ray x = c; 
break; 


= 255; 

= 25 5; 


= 0; 
= 0; 
= 255; 
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} 

} 


/* 

for(int y=obj->y min; y<=obj->y max; y++) 
{ 

for(int x=ob j - >x_min ; x<=obj ->x_max; x++) 

{ 

est ring msg; 

msg . Format (" i=%d. objlabel=%d, label=%d xTnin=%d xmax=%d ymin=% 

ymax=%d xstart=%d ystart=%d", i; ot)j->label, ( (int*)m_labellmage->image_ptr [0] 

>rpt2r [yj ) [x] , obj->x_min, obj->x_max, obj - >y_min, obj->y_max) ; 

AfxMessageBox (msg) ; 

} 

} 


Object Info* info ^ new Obj ect Info; 


if (buildChaincode) 

3 1 

info->chain = new_ChainCode (obj - >y_min, ray_x, obj->label); 
^'pj if ( ! build_LineChainCode (inf o- >chain, m_label Image , obj->x_min, obj 

;'?y_min , obj - >x_max ^ obj - >y_max) ) 

AfxMessageBox ("Error building chain code") ; 

J, //print_ChainCod6 (infolist [i] ->chain, "chaininfo.txt") ; 

'^il^^ inf o->perimeter = inf o->chain- >no_of_vectors ; 

ry J 

info->area = obj ->prop . area; 

info->label = obj->label; 
01 info->eigenratio = obj ->prop . eig_ratio; 

info- >orientat ion = obj ->prop. orientation; 
•vS inf o->xcenter = ob j - >prop . h_cog ; 

□ info->ycenter = obj->prop.v_cog; 

Q info->xmin = obj->x_min; 

info - >xmax = obj - >x_max ; 
info->ymin = obj->y_min; 
info - >ymax - obj - >y_max ; 

//inf o->junctions = Compute Junctions (inf o) ; 
infolist .push_back (inf o) ; 
next__LL (m__obj ect list) ; 


return infolist; 

} 

std: : vector<ExImage*> BinaryObj ects : : CreateColorlmages (std : : vector<Obj ectinf o*> infolist 
ImagelO* original) 

{ 

std: :vector<ExImage*> imglist; 

int** lab = (int**)in_labellmage->image_ptr [0] ->rptr; 

unsigned char** origR = original - >GetPixelArray (0) ; 
unsigned char** origG = original - >GetPixelArray (1) ; 
unsigned char** origB = original ->GetPixelArray (2) ; 

for(int i=0; i<inf olist . size () ; i++) 
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{ 

Objectlnfo* info = infolist [i] ; 

// Create a color image for the object. 

Image* returnimg = new_I mage (PPM, RGB, 3, iTifo->ymax - info->ymin + 1, 
info->xmax - info->xmin + 1, CVIP_BYTE, REAL) ; 


unsigned char** destR = (unsigned char**) returnimg- >image_jptr [0] ->rptr; 
unsigned char** destG = (unsigned char**) returnimg- >image_j)tr [1] ->rptr; 
unsigned char** destB = (unsigned char**) returnimg- >image_ptr [2] ->rptr ; 


int count = 0 ; 


J 


for (int y=inf o->ymin; y<=inf o- >ymax; y++) 

{ 

for (int x=inf o- >xmin/ x<=inf o- >xmax; x++) 

{ 

int ny = y - info~>ymin; 

int nx = X - info->xmin; 

if(lab[y][x] == info->label) 

{ 

destR [ny] [nx] = origR [y] [x] 
destG [ny] [nx] = origG [y] [x] 
destB [ny] [nx] = origB [y] [x] 

count++; 


} 

else 

{ 


destR [ny] [nx] = (unsigned char)0; 
destG [ny] [nx] = (unsigned char)0; 
destB [ny] [nx] - (unsigned char)0; 


f } 

9 } 

J Eximage* newimage = new Eximage; 

newimage->m_image = returnimg; 

imglist.push_bacK (newimage) ; 

} 

return imglist; 

} 

Eximage* BinaryObjects : :CreateColorImage (Objectlnfo* info, ImagelO* original) 

{ 

int** lab = (int** ) m_label Image - >image__ptr [0] - >rptr; 
unsigned char** origR = original->GetPixelArray (0) ; 
unsigned char** origG = original- >GetPixelArray (1) ; 

unsigned char** origB = original ->GetPixelArray (2) ; 

// Create a color image for the object. 

Image* returnimg = new_Image (PPM, RGB, 3, info->ymax - info->ymin + 1, 
info->xmax - info->xmin + 1, CVIP_BYTE, REAL) ; 

unsigned char** destR = (unsigned char**) returnimg- >image_j)tr [0] ->rptr; 
unsigned char** destG = (unsigned char**) returnimg- >imagejitr [1] - >rptr; 

unsigned char** destB = (unsigned char**)returnimg->imagej}tr [2] ->rptr; 
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int count = 0; 


for(int y=info->yinin; y<=info->yinax; y++) 

{ 

for {int x=inf o->xmin; x<=info->xmax; x++) 

{ 

int ny = y - info->ymin; 
int nx = X - info->xmin; 

if(lab[y][x] == info->label) 
{ 

destR [ny] [nx] origR [y] [x] ; 
destG [ny] [nx] = origG [y] [x] ; 
destB [ny] [nx] = origB [y] [x] ; 

counttt; 

} 

else 

{ 


} 


} 


destR [ny] [nx] = (unsigned char)0; 
destG [ny] [nx] = (unsigned char)0; 

destB [ny] [nx] = (unsigned ctiarjo; 


} 

Eximage* newimage - new Eximage; 
newimage - >m_image = re turnimg ; 

return newimage; 


'^ytd: :vector< Junction* > BinaryObj ects : : ComputeJunctions (Obj ectinf o* objinfo) 

1 

;=y std : :vector< Junction* > junclist; 

int** pix = (int**) m_labellmage->image_ptr [0] ->rptr; 
int label = obj info- >label ; 

for (int y=obj inf o->ymin; y<=obj inf o->ymax; y++) 

for (int x=objinf o->xmin; x<=obj inf o->xmax; x++) 

{ 

std: : set<int> neig]ibor; 

if (pix [y] [x] == label) 
{ 

// neighbor 
// 5 S 7 
// 4 0 
// 3 2 1 

int deg=0; 

if ( (x!=objinfo->xmax) && (pix [y] [x+1] == label)) 
( 

deg++; 

neighbor .insert (0) ; 

} 

if ( (y!=objinfo->ymin) && (pix[y-l] [x] == label)) 

{ 
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deg++; 

neighbor. insert (6) ; 

} 

if ( (xI=objinfo->xmin) (pix[y][x-l] == label)) 

{ 

deg++; 

neighbor. insert (4) ; 

} 

if { (y l=objinfo->ymax) && (pix[y+l][x] == label)) 

{ 

deg++ ; 

neighbor. insert (2) ; 

} 

if ( (y !=objinfo->ymin) && (x!=objinfo->xmax) && (pix [y-1] [x+1] == 

label) ) 

{ 

if ( (neighbor . find (6) ==neighbor . end () ) 

(neighbor .find (O) ==neighbor . end () ) ) 

{ 

deg++; 

neighbor . insert { 7 ) ; 

S } 

- ! . 

i£ ( (y!=ob]in£o->ymin) (x!=objinfo->xmin) (pix [y-1] [x-1] == 

label) ) 

if ( (neighbor . find (4) ==neighbor. end {) ) 
^^neighbor . find (6) ==neighbor . end () ) ) 

{ 

deg++; 

0 neighbor . insert (5) ; 

□ } 

™! } 

3 if ( (y ! =obj inf o- >ymax) (x ! =obj inf o- >xTnin) && (pix[y+l] [x-1] = = 

label) ) 

{ 

if ( (neighbor. find (2) ==neighbor . end () ) 
(neighbor . find (4 ) ==neighbor . end ( ) ) ) 

{ 

deg++; 

neighbor . insert (3 ) ; 

} 

} 

if ( (y ! =obj inf o->ymax) && (x ! =obj inf o- >xTnax) && (pix [y+1] [x+1] = = 

label)) 

{ 

if ( (neighbor . find (0) ==neighbor . end () ) 

(neighbor . find (2 ) ==neightior . end () ) ) 

{ 

deg++; 

neighbor . insert (1) ; 

} 

} 

// Modify neighborhood list based on the following rules: 
//if the neighbor is odd and there is an adjacent neighbor, 

// remove the neighbor from the list. 
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h 

std: : set<int> :: iterator it = neighbor .begin () ; 
int c = 0; 

while (it \= neighbor .end 0 ) 

{ 

if(*it % 2 == 1) 

{ 

int n = *it; 

int nl = (n != 0) ? n-1 : 7; 
int n2 = (n 1= 7) ? n+1 : 0; 

if ( (neighbor . find (nl) 1= neighbor . end () ) 

(neighbor. find (n2) i= neighbor . end ()) ) 

{ 

it = neighbor . erase (it) ; 
deg--; 

} 

} 

else 

^ it++; 

if(c>10) 

|^=y Af xMe s s ageBox ( " ERROR " ) ; 

"0 C++; 

.y } 

'"-'r if(deg != 2) 

ry Junction *junc = new Junction; 

junc->m_degree = deg; 
□ junc->m_x = X; 

lO junc->Tn_y = y; 

r™. junc->m_neighbor Pixels = neighbor; 

junclist .push_back ( junc) ; 

n } 

a , > 

return junclist; 

} 


void BinaryObj ects :: Merge Junctions (ConnectivityGraph<Edge *> *jgraph, float 

mergeDi stance) 

{ 

// juncs keeps track of junctions that belong to "short" edges. 

std: : set<int> juncs; 

std: : set<int> : : iterator it; 

Point* juncpos = new Point [ jgraph->GetSize ()] ; 
for (int i=0; i< jgraph->GetSize () ; i++) 

{ 

// Find edges that are short enough and put their junctions into juncs. 
// Remove those edges. 

for(int j=i+l; j < jgraph->GetSize () ; j++) 

{ 

if ( jgraph->IsEdge (i, j) ) 
{ 
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if (]graph->GetEdge(i, j) ->m__length < mergeDistance) 

{ 

juncpos[i] = jgraph->GetEdge (i, j) ->GetEndPosition(i) ; 

juncs . insert (i) ; 
juncs . insert ( j ) ; 
j graph- >DeleteEdge ( i , j ) ; 

} 

} 

} 

} 

std: :vector<std: :vector<int> > groups; 

// Look at junctions' connectivity and divide them into groups 
// of connected junctions, 
while { ! juncs .empty {) ) 
{ 

Std: :vector<int> list; 
groups .push_back (list) ; 

int current = * j uncs . begin () ; 
groups . rbegin {) ->push_back (current) ; 
juncs . erase (juncs .begin () ) ; 

std: :vector<int> worklist; 
do 

{ 

it - juncs .begin 0 ; 
while (it I = Juncs . end ( ) ) 

{ 

if (j graph- >IsEdge (current, *it)) 
{ 

worklist .push_back (*it) ; 

it = juncs. erase (it) ; 

} 

else 

it++; 

} 

if (worklist . empty () ) 
break; 

current = *worklist .begin {) ; 
worklist . erase (worklist . begin () ) ; 

groups . rbegin ( ) - >pus]i_back (current) ; 

} while (! worklist .empty 0 ) ; 

int* newjunclndex = new int [groups . size ()] ; 
Point* newjuncPos = new Point [groups . size ()] ; 

// Compute the centroid for each group and make it a new junction. 
for(i=0; i<groups . size ( ) ; i++) 

{ 

float sumx = O.Of; 

float sumy = O.Of; 

for (int j=0; j <groups [i] . size 0 ; j++) 

{ 

sumx += juncpos [groups [i] [j]] .x; 
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} 


sumy += juncpos [groups [i] [j]] .y/ 

} 

sumx /= groups [i] . size 0 ; 

sumy )= groups [i] .sizeO; 

Point pt (ROUND (suTTix) , ROUND (sumy) ) ; 

newjuncPos [i] = pt; 

newj unc Index [i] = groups [i] [0] ; 


for(i = 0/ i<groups . size 0 ; i++) 

( 

for(int j=0; j <groups [i] . size ( ) ; j++) 

{ 

// Modify all edges that are connected to groups [i] [ j ] 

for(int k=0; k<jgraph->GetSize () ; k++) 


{ 


"•^ergeDi Stance) ; 

n 

Lil 

'^fespect to X-axis) 


if (jgraph->IsEdge (groups [i] [j], k) ) 


{ 


Edge* edge = jgraph->GetEdge (groups [i] [j ] , k) ; 

y / Adds egment End (edge, newjuncPos [i] , newj unc Index [i] , k, 

// Compute the angle the edge forms at each junction (with 

// 1. angle at junction 1 

int chainlen = edge->m_xarray . size () ; 

int endlndex; 


if (newj unc Index [i] edge->m_juncl) 
endlndex = 0; 

else 

endlndex = chainlen - 1; 


int dx = newjuncPos [i] .x - edge- >m_xar ray [endlndex] ; 
int dy = newjuncPos [i] .y - edge- >m_yarray [endlndex] ; 


if (dx 
{ 


} 

else 

{ 


0) 

if (dy > 0) 

{ 


} 

else 

{ 


if (newjunclndex [i] == 
edge- >m_anglel 

else 

edge - >m_angl e 2 


: edge ->m__j unci) 

= HPI; 
= HPI; 


i f ( newj unc Index [ i ] = 
edge - >m_angl e 1 
else 

edge->m_angle2 = -HPI; 


e dge - >m__ j unc 1 ) 

-HPI; 


i f ( newj unc Index [ i ] = = edge - >m_ j unc 1 ) 
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edge->Tn_anglel = atan2 ( (double) -dy, 

(double) dx) ; 

else 

edge->m_angle2 = at an2 ( (double) -dy , 

(double) dx) ; 

} 

} 

} 

} 

} 

} 

void BinaryObjects : :AddSegmentEnd (Edge* edge. Point newPos, int newlndex, int otherlndex, 
float msrgeDistance) 

{ 

// Connect the edge to the newly formed junction. 

ASSERT (edge- >Tn__j unci == otherlndex || edge->mjunc2 == otherlndex); 

if (edge- >m_j unci == otherlndex) 
■ edge->m_junc2 = newlndex; 

!% else 

j-'J edge- >m_j unci = newlndex; 

i 

i^/ Helper function for GetObj ectinf o , 

^jvoid BinaryObjects :: Compute Junctions (Ob j ectinf o* objinfo. Junction **junctions, int 
Lpnum j unc ) 

Q int xmin = objinf o->xmin; 

int ymin = obj inf o->ymin; 

O int xmax - obj info- >xmax; 

O lilt ymax - obj inf o->ymax; 

// Convert the chain code into a list of (x,y) . 
int *xP=NULL, *yP=NULL; 

getXY_ChainCode (obj inf o->chain, &xP, SLyP) ; 

// count is a counter for each coordinate in the chain code, 
int** count = new int* [ymax-ymin+1] ; 
for (int i=0; i<ymax-ymin+l; i++) 

{ 

count [i] = new int [xmax-xmin+1] ; 
// Reset counter. 

for (int j=0; j<:xmax-xmin4.1; 

count [i] [ j ] = 0 ; 

} 

num j unc = 0 ; 

for(i = 0; i<obj inf o->chain->no_of__vectors ; i++) 

( 

// Increment numjunc if the junction degree is greater than 2. 
if (count [yP [i] -ymin] [xP [i] -xmin] == 2) 

{ 

numj unc++; 
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} 

(count [yP [i] -ymin] [xP [i] -xmin] ) ++; 

} 


// No junction. 
if(numjunc == 0) 

{ 

* junctions = NULL; 
return; 

} 


Junction* newjunctions = new Junction [numjunc] ; 


int jc = 0; 

for(i=0; i<ymax-ymin+l; i++) 

for (int j=0; j <xmax-xmin+l ; j++) 

{ 

i£ (count [i] [j] >= 3) 

{ 

newjunctions [jc] .degree = count [i] [j] ; 
newjunctions [j c] .X = j+xmin; 

newjunctions [jc] .y = l+ymin; 

jc + +; 

} 

} 

* junctions = newjunctions; 
ASSERT (jc == numjunc) ; 

/ / Clean up . 

delete [] xP; 
delete [] yP; 


".gsrpedef HashTable *ObjectHash; 

#define HASH SIZE 251U 


#define hash_Obj ect (label) (((unsigned) (label) ) %HASH_SIZE) 


static void addto_Obj ects (Obj ectHash hashP, int next_label. Color pixel, int yjos, int 
x_j)Os) ; 

static void update_Obj ects (Obj ectHash hashP, int ob j ect_label , int y Jos , int x_j)os) ; 
static void coTTibine_Obj ects (Obj ectHash hashP, int b, int c, int *xmin, int *xmax, int 
*ymin, int *yTnax) ; 

static ObjectList hash2List_0bj ects (Obj ectHash hashP) ; 
static void makegraymap_Obj ects (ColorHistogram *chP) ; 

Static Matrix *color2index_Image (ColorHistogram *chP, Image *imageP ); 

/* 

* label recycling routines 
*/ 

static void initLabelStack(void) ; 

static int getNextLabel (void) ; 
static void recycleLabel (int label); 
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/* 

* global variables used by label recycling routines 

*/ 

static int label_count; 
Static Stack label_stackP; 

Obj ectList 
label_Obj ects2 ( 

Image *imageP, 
Image **labelP, 
unsigned background 
) 

{ 

register int x, y=0, i, j; 
int A, B, C, D, rows, cols; 

byte *pixarray2, *pixarrayl; /* pixel arrays */ 

int *labarrayl, *labarray2, *rowP; /* label arrays */ 

int xmin, xmax, ymin, ymax, next_label; 

unsigned *A_LABEL, B_LABEL, C_LABEL, D_LABEL, MAX_LABEL; 
J ObjectList listP; 

ObjectHash hashP; 
Object *objP; 
ColorHistogram *chP; 

■'I ColorHistOb^ect *mapP; 

F= Matrix *matrixP; 

'fj ROI *roiP; 

iZ const char *fn = "label"; 

chP = new_ColorHist ( ) ; 

if (getNoOf Bands Image (imageP) > 1) { 

compute__ColorHist (chP, imageP, 256); 
matrix? = color2index_Image (chP, imageP) ; 

{ 

makegraymap_Obj ects (chP) ; 
matrixP = getBand_Image (image P, 0) ; 


mapP = chP->histogram; 

if (mapP==lsrULL) return NULL; 

rows = getNoOf Rows_Image (imageP) ; 
cols = getNoOf Col s_Image (imageP) ; 

*labelP = new_Image(PGM, GRAY_SCALE, 1, rows, cols, CVIP_INTEGER, REAL); 

pixarray2 = (unsigned char*) getRow_Matrix (mat rixP, 0) ; 
labarray2 = (int *) get Row_Image (* label P, 0, 0); 

initLabelStackO ; 

hashP = new__HT(HASH_SIZE) ; 
/* 

* handle special case of first row 


} 

else 
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for(x=0; X < cols; x++) 

if( pixarray2 [x] 1= background ) ( 

if ( (x==0) II (pixarray2 [x-l] != pixarray2 [x] ) ) { 
next_label = getNextLabel ( ) ; 

addto_Objects (hashP, next_label, mapP [pixarray2 [x] ] .pixel , y, x) ; 
labarray2 [x] = next_label; 

} 

else ( 

update_Objects (hashP, labai:ray2 [x-l] , y, x) ; 

labarray2 [x] = labarray2 [x-l] ; 

} 

} 

for(y=0; y < rows-1; y++) 

{ 

pixarrayl = pixarray2 ; 

pixarray2 = (unsigned char*) getRow__Matrix(n\atrixP/ ytl) ; 
labarrayl = labarray2; 

labarray2 = (int *) getRow_Image (* label P, y+1, 0); 
for(x=0; X < cols-1; x++) 

{ 

A = pixarray2 [x+l] ; 
B = pixarray2 [x] ; 
C = pixarrayl [x+1] ; 
D = pixarrayl [x] ; 

A_LABEL = (unsigned *) £clabarray2 [x+1] ; 
B_LABEL = labarray2 [x] ; 
C_LABEL = labarrayl [x+1] ; 
D_LABEL = labarrayl [x] ; 

if (x == 0) 
{ 

if (B != baclcground) 
i£(D == B) 
{ 

B_LABEL = labarray2 [x] = D_LABEL; 
update_Objects (liasliP, B LABEL, y+1, x) ; 

} 

else 

{ 

next_label = getNextLabel () ; 

addto_Objects (hashP, next label. 


mapP[B] .pixel, y+1, x) ; 


B_LABEL = labarray2 [x] = next label; 

} 

} // x==0 

if (A != background) 
{ 

if (D != A) 
{ 

if (B != A) 
{ 
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iiextJabel,n\apP[A] .pixel, y+i, x+i); 


if{C 1= A) 
{ 

next__label = getNextLabel { ) ; 
addto_Objects (hashP, 

*A_LABEL = next_label; 
} // C1=A 
else 


x+1) ; 


..p_LABEL , &xmin , &xmax , 


Jplin, mx-xmin+1. 


*A_LABEIj = C_riABEL; 

update_Objects (hashP, 
} // C==A 

} // B!=A 
else 

{ 

i£ (C == A) 

{ 

if (B LABEL == C LABEL) 


*A_LABEL, y+1. 


i++) { 

getRow_ROI (roiP, i, 0) ; 
getNoOfCols_ROI (roiP) ,- rowP++) 


{ 
} 

else 

{ 


*A_LABEL = B_LABEL; 

combine_Obj ects (hashP, 
&:ymin, Symax) ; 


B LABEL, 


MAX_LABEL = MAX (B_LABEL, C_LABEL) ; 
*A_LABEL = MIN(B_LABEL,C_LABEL) ; 

roiP = new_ROI(); 

asgnImage_ROI(roiP, *labelP, xmin, 
ymax-ymin+l) ; 

for(i=0; i < getNoOfRows_ROI (roiP) ; 
rowP = (int *) 

for(j=0/ j < 


} 


i£(*rowP == MAX_LAEEL) 
*rowP = *A LABEL ; 


delete_ROI (roiP) ; 
} // B_LABEL ! =C_LABEL 
} // C==A 
else 

*A_LABEL = B_LABEL; 

update_Objects (hashP, *A_LABEL, y+1, x+1) ; 
} // B!=A 
} // D!=A 
else 

{ 
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&:xmax , 


xmin+1, 


^~irowP++) 


:^€irase 


*A_LABEL = D_LABEL; 

update_Objects (hashP, * A LABEL, y+1, x+1) ; 
} // D==A 
} // A I =backgrouiid 

else // addition by Yusaku Sako. 7/26/99 


{ 


if (B != background) 

if{(B == C) && (D != B) && (B_LABEL != C_LABEL) ) 


combine_Objects (hashP, B_LABEL, C_LABEL, &xmin, 

tymin, £ymax) ; 

MAX_LABEL = MAX (B_LABEL , C__LABEL) ; 

B_LABEL = labarray2 [x] = MIN" (B__LABEL, C_LABEL) ; 

roiP = new_ROI(); 

asgnImage_ROI (roiP, *labelP, xmin, ymin, xmax- 

ymax-ymin+l) ; 
for(i=0; i < getWoOf Rows_ROI (roiP) ; i++) { 

rowP = (int *) getRow_ROI (roiP^ i, 0) ; 

for(j=0; j < getNoOf Cols_ROI (roiP) ; 


} 


if(*rowP == MAX_LABEL) 
*rowP = B_LABEL; 


delete_ROI (roiP) ; 

update_Objects (hashP, B_LABEL, y+1. 


X) ; // 


} 


} // A==background 
} // for X 
} // for y 

if {hashP->table [hashP->key] ) 

listP = hash2List_0bjects (hashP) ; 

else 

listP = NULL; 

/* 

fprintf (stderr, "Displaying Object Statistics ... ) ; 

fprintf (stderr, "Number of objects found = %u.\n\n", size_LL (listP) ) ; 

print_Objects (listP) ; 

fprintf (stderr, "\n\n Press the <ENTER> key to continue"); 

getchar () ; 

*/ 

// Bug fix by YS (3/24/00) . 

// Don't wanna delete matrixP when number of bands is 1 
if (getNoOfBands__Image(imageP) > 1) ( 

delete_Matrix (matrixP) ; 

} 

return listP; 
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} 

static ObjectList hash2List_0bj ects (Ob j ectHash hashP) 

{ 

register int i, first = 0; 

ObjectList listP; 

for(;;) { 

if (hashP->table [first] ) break; 

firsttt; 

} 


listP = hashP->table [first] ; 


for (i=f irst+1; i < size_HT (hashP) ; i++) 
if (hashP->table [i] ) { 


* (listP->tailP) = * (hashP->table [i] ->headP- >nextP) ; 

listP->tailP = hashP->table [i] ->tailP; 

listP->listlength += size_LL (hashP->table [i] ) ; 
Q delete_Link (hashP->table [i] ->headP->nextP) ; 

delete__Link (hashP-> table [i] ->headP) ; 
1.0 /* delete_Link (hashP->table [i] ->headP->nextP) ; */ 

v3 free (hashP->table [i] ) ; 

S } 

return listP; 

J'gtatic void addto_Obj acts (Obj ectHash hashP, int next_label. Color pixel, int y_pos, int 
j'K_JPOS ) 

setKey_HT (hashP, hash_Object (next_label) ) ; 

addOb j ect_HT ( hashP, new_Object (next__label, pixel, y_j)os, x_j>os) ); 

q 

static void update_Objects ( ObjectHash hashP, int object_label, int y_j)os, int xjos) 

{ 

Object *obj ; 

const char *fn = "update_Objects" ; 


setKey_HT (hashP,hash_Object {object_label) ) ; 


if (f indObject_HT (hashP, match_Obj ect , &:object_label) ) { 
obj = (Object*) getObject_HT (hashP) ; 


obj -> x_Tnin = MIN(obj 

obj -> x_Tnax = MAX (obj 

obj -> y_Tnin = MIN(obj 

obj -> y_max = MAX (obj 


-> x__min, x_pos) ; 

-> x_max, x__pos) ; 

-> y_min^ yj>os) ; 

y__^^^' y_Jpos) ; 


static void combine_Obj ects (Obj ectHash hashP, int b, int c, int *xmin, int *xmax^ int 
*ymin, int *ymax) 
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{ 

dlink *linkP; 
Object *bP, *cP/ 

if (b < c) 
{ 

int temp ; 
temp = b; 
b = C; 
c = temp; 

} 

setKey_HT(hashP^hash_Object (b) ) ; 

f indNextOb:ect_HT(hashP, match_Object , £b) ; 
bP = (Object*)getNextObject_HT(hashP) ; 
removeNextObject_HT(hashP) ; 

setKey_HT (hashP^ hash_Obj act (c) ) ; 

£indOb3ect_HT(hashP, match_Ob]ect, £c) ; 

cP = (Object*) getObject_HT (hashP) ; 

*xmin = bP->x_min; 
H *xmax = bP->x_max; 

.,o *ymin = bP->y_min; 
'^^ *ymax = bP->y_max; 

_ CP -> x_min = iyiIN(cP 
cP -> x__max = MAX(cP 
cP -> y^min = iyiIN(cP 
cP -> y_max = MAX(cP 

^ delete__Obj ect (bP) ; 

' recycleLabel (b) ; 


static void make graymap_Obj ect s ( ColorHistogram *chP ) 
{ 

register int i; 

chP->histogram = (ColorHistObj ect *) malloc (256*sizeof (ColorHistObject) ) 

for(i=0; i < 256; i+-f) 

as s ign_Color (chP- >histogram [i] .pixel , i, i, i) ; 

} 


-> x__min, bP->x_min) ; 

-> x_max, bP->x_max) ; 

-> y^min, bP->y min) ; 

-> y_max, bP->y_max) ; 


static Matrix *color2index_Image (ColorHistogram *chP, Image *imageP ) 
{ 

Matrix *matrixP; 

Color pixel; 
ColorHashTable *chtP; 
unsigned rows, cols; 
register int i; 
byte *mP, *rP, *gP, *bP; 
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if (chP->no_of_colors > 256) { 
return NULL; 

} 

rows = getNoOfRows^Image (imageP) ; 
cols = getNoOf Cols_lTnage (imageP) ; 

rP = (unsigned char*) get Row_Image (image P, 0, RED) ; 
gP = (unsigned char*) get Row_lTnage (image P, 0, GRN) ; 
bP = (unsigned char*) getRow_Image (imageP, 0, BLU) ; 

matrix? = new_Matrix (rows, cols, CVIP_BYTE, REAL) ; 
mP = (unsigned char*) getRow_Matrix (mat rixP, 0) ; 

chtP = hist2Hash_ColorHT(chP) ; 

for(i=0; i < rows*cols; i++, mP++, rP++, gP++, bP++) { 
assign_Color (pixel, *rP, *gP, *bP) ; 

if( (*mP = lookUpColor_ColorHT ( chtP, pixel )) == -1 ) 
return NULL; 

M delete_ColorHT(chtP) ; 

return matrix? ; 

4 


..Static void initLabelStack (void) 

label_stackP = new_Stack(); 
label__count=l ; 


tatic int getNextLabel (void) 

int next__label, *labelP; 

if {isempty_Stack (label_stackP) ) 

next_label = label_count++; 

else { 

labelP = (int*)pop_Stack(label_stackP); 

next_label = *labelP; 
free (labelP) ; 

} 

return next_label; 


static void recycleLabel (int label) 

{ 

int *labelP = (int *) malloc (sizeof (int) ) ; 
*labelP - label; 

push_Stack (label_stackP, labelP) ; 

} 
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// Connectedness. Used in I mage Thinning function, 
int cconc(int inb[9]) 

{ 

int icn = 0/ 

for (int i=0; i<8; i+=2) 

{ 

if (inb[i]==0) 

i£(inb[i+l] == 255 II inL[i+2] == 255) 
icn++; 

} 

return icn; 

} 

// Performs thinning of a binary image 
Image* ImageThinning (Image *img) 

{ 

// Copy original image 

Image *newimg = duplicate_Image (img) ; 

if(!newlTng) 

y AfxMessageBox ( "Not enough memory! "); 

unsigned char **pix = (unsigned char **) newimg-> image j>tr [0] ->rptr; 
'-^^ int m = 100; int ir = 1, ia[9], ic [9] ; 

int numrows = img->image j>tr [0] ->rows ; 
J. int numcols = img->image_ptr [0] ->cols ; 


while (ir 1=0) 

*0' { 

CO ir=0; 

,Q for (int iy=0; iy < numrows ; iy++) 

''•'Z for (int ix=0; ix < numcols; ix++) 

,j { 

if (pix[iy] [ix] != 255) 



continue; 

if (ix 

== numcols -1) 


ia[0] 


0; 

else 





ia[0] 


pix[iy ] [ix+1] ; 

if (iy 

== 0 

li 

ix == numcols -1) 


ia[l] 


0; 

else 





ia[l] 


pix[iy-l] [ix+1] ; 

if (iy 

0) 




ia[2] 


0; 

else 





ia[2] 


pix[iy-l] [ix ] ; 

if (iy 

== 0 

li 

ix == 0) 


ia[3] 


0; 

else 





ia[3] 


pix[iy-l] [ix-1] ; 

if (ix 

== 0) 




ia[4] 


0; 
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else 

ia[4] = pix[iy ] [ix-1] ; 
if (iy == numrows-1 [ | ix == 0) 
ia[5] = 0; 

else 

ia[5] = pix[iy+l] [ix-1] ; 

if (iy == numrows-1) 

ia[6] = 0; 

else 

ia[6] = pix[iy+l] [ix ]; 
if (iy == numrows-1 | ] ix == numcols-1) 

ia[7] = 0; 

else 

ia[7] = pix[iy+l] [ix+1] ; 


for(int i=0; i < 8; 

{ 

if (ia [i] == m) 

{ 

ia[i] = 255; ic [i] =0; 

□ } 

else 

Vp if (ia [i] < 255) 

U ia[i] = 0; 

ic[i] = ia[i]; 

rn } 
;^ } // for 

ia [8] = ia [0] ; 
'L ic [8] = ic [0] ; 

y if (ia [0] +ia [2] +ia [4] +ia [6] ==255*4) 

continue; 

int iv, iw; 

P for(i=0, iv=0, iw=0; i<8; i++) 

a { 

if (ia[i]==255) 

iv++ ; 
if (ic [i] = = 255) 

iw++ ; 

} 

if (iv<=l) 

continue ; 

if (iw==0) 

continue ; 

if (cconc (ia) !=1) 

continue; 


int temppix = (iy ==0) ? 0 : pix[iy-l] [ix] 

if (temppix == m) 
{ 

ia[2] = 0; 

if (cconc (ia) 1= 1) 

continue; 
ia[2] = 255; 

} 

temppix = (ix == 0) ? 0 : pix[iy] [ix-1] ; 
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if (temppix == m) 

{ 

ia[4]=0; 

if (cconc (ia) ! =1) 
continue; 
ia[4] = 255; 

} 

pix[iy] [ix] = m; 
ir++; 
} // for ix 
} // for iy 
m++; 

} // while 

for(int iy=0; iy<img->image_ptr [0] - >rows ; iy++) 

{ 

for(int ix=0; ix<img->image_ptr [0] - >cols ; ix++) 

{ 

if (pix[iy] [ix] < 255) 
pix[iy] [ix] = 0; 

} 

□ } 

^ return newimg; 

B 
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